Aug 16 17:56:00 user nova-compute[72000]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 16 17:56:03 user nova-compute[72000]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72000) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72000) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72000) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 16 17:56:03 user nova-compute[72000]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 17:56:03 user nova-compute[72000]: INFO nova.virt.driver [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 16 17:56:03 user nova-compute[72000]: INFO nova.compute.provider_config [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] Acquiring lock "singleton_lock" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] Acquired lock "singleton_lock" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] Releasing lock "singleton_lock" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] Full set of CONF: {{(pid=72000) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ******************************************************************************** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] Configuration options gathered from: {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ================================================================================ {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] allow_resize_to_same_host      = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] arq_binding_timeout            = 300 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] backdoor_port                  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] backdoor_socket                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] block_device_allocate_retries  = 300 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] block_device_allocate_retries_interval = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cert                           = self.pem {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute_monitors               = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] config_dir                     = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] config_drive_format            = iso9660 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] config_source                  = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] console_host                   = user {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] control_exchange               = nova {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cpu_allocation_ratio           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] daemon                         = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] debug                          = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] default_access_ip_network_name = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] default_availability_zone      = nova {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] default_ephemeral_format       = ext4 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] default_schedule_zone          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] disk_allocation_ratio          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] enable_new_services            = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] enabled_ssl_apis               = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] flat_injected                  = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] force_config_drive             = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] force_raw_images               = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] graceful_shutdown_timeout      = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] heal_instance_info_cache_interval = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] host                           = user {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] instance_build_timeout         = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] instance_delete_interval       = 300 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] instance_name_template         = instance-%08x {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] instance_usage_audit           = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] instance_usage_audit_period    = month {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] internal_service_availability_zone = internal {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] key                            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] live_migration_retry_count     = 30 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] log_config_append              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] log_dir                        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] log_file                       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] log_options                    = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] log_rotate_interval            = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] log_rotate_interval_type       = days {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] log_rotation_type              = none {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] long_rpc_timeout               = 1800 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] max_concurrent_builds          = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] max_concurrent_live_migrations = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] max_concurrent_snapshots       = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] max_local_block_devices        = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] max_logfile_count              = 30 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] max_logfile_size_mb            = 200 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] maximum_instance_delete_attempts = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] metadata_listen                = 0.0.0.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] metadata_listen_port           = 8775 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] metadata_workers               = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] migrate_max_retries            = -1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] mkisofs_cmd                    = genisoimage {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] my_ip                          = 10.0.0.210 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] network_allocate_retries       = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] osapi_compute_listen_port      = 8774 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] osapi_compute_unique_server_name_scope =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] osapi_compute_workers          = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] password_length                = 12 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] periodic_enable                = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] periodic_fuzzy_delay           = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] pointer_model                  = ps2mouse {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] preallocate_images             = none {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] publish_errors                 = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] pybasedir                      = /opt/stack/nova {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ram_allocation_ratio           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] rate_limit_burst               = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] rate_limit_except_level        = CRITICAL {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] rate_limit_interval            = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] reboot_timeout                 = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] reclaim_instance_interval      = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] record                         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] reimage_timeout_per_gb         = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] report_interval                = 120 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] rescue_timeout                 = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] reserved_host_cpus             = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] reserved_host_disk_mb          = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] reserved_host_memory_mb        = 512 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] reserved_huge_pages            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] resize_confirm_window          = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] resize_fs_using_block_device   = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] resume_guests_state_on_host_boot = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] rpc_response_timeout           = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] run_external_periodic_tasks    = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] running_deleted_instance_action = reap {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] running_deleted_instance_timeout = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler_instance_sync_interval = 120 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_down_time              = 720 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] servicegroup_driver            = db {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] shelved_offload_time           = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] shelved_poll_interval          = 3600 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] shutdown_timeout               = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] source_is_ipv6                 = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ssl_only                       = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] state_path                     = /opt/stack/data/nova {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] sync_power_state_interval      = 600 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] sync_power_state_pool_size     = 1000 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] syslog_log_facility            = LOG_USER {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] tempdir                        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] timeout_nbd                    = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] transport_url                  = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] update_resources_interval      = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] use_cow_images                 = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] use_eventlog                   = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] use_journal                    = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] use_json                       = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] use_rootwrap_daemon            = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] use_stderr                     = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] use_syslog                     = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vcpu_pin_set                   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plugging_is_fatal          = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plugging_timeout           = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] virt_mkfs                      = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] volume_usage_poll_interval     = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] watch_log_file                 = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] web                            = /usr/share/spice-html5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_concurrency.disable_process_locking = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.auth_strategy              = keystone {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.compute_link_prefix        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.dhcp_domain                = novalocal {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.enable_instance_password   = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.glance_link_prefix         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.instance_list_per_project_cells = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.list_records_by_skipping_down_cells = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.local_metadata_per_cell    = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.max_limit                  = 1000 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.metadata_cache_expiration  = 15 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.neutron_default_tenant_id  = default {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.use_forwarded_for          = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.use_neutron_default_nets   = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.vendordata_dynamic_targets = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.vendordata_jsonfile_path   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.backend_argument         = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.config_prefix            = cache.oslo {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.dead_timeout             = 60.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.debug_cache_backend      = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.enable_retry_client      = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.enable_socket_keepalive  = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.enabled                  = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.expiration_time          = 600 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.hashclient_retry_attempts = 2 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.memcache_dead_retry      = 300 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.memcache_password        =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.memcache_sasl_enabled    = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.memcache_username        =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.proxies                  = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.retry_attempts           = 2 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.retry_delay              = 0.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.socket_keepalive_count   = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.socket_keepalive_idle    = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.socket_keepalive_interval = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.tls_allowed_ciphers      = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.tls_cafile               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.tls_certfile             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.tls_enabled              = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cache.tls_keyfile              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.auth_section            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.auth_type               = password {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.cafile                  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.certfile                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.collect_timing          = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.cross_az_attach         = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.debug                   = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.endpoint_template       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.http_retries            = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.insecure                = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.keyfile                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.os_region_name          = RegionOne {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.split_loggers           = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cinder.timeout                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.cpu_dedicated_set      = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.cpu_shared_set         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.image_type_exclude_list = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.resource_provider_association_refresh = 300 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.shutdown_retry_interval = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] conductor.workers              = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] console.allowed_origins        = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] console.ssl_ciphers            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] console.ssl_minimum_version    = default {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] consoleauth.token_ttl          = 600 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.cafile                  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.certfile                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.collect_timing          = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.connect_retries         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.connect_retry_delay     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.endpoint_override       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.insecure                = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.keyfile                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.max_version             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.min_version             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.region_name             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.service_name            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.service_type            = accelerator {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.split_loggers           = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.status_code_retries     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.status_code_retry_delay = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.timeout                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] cyborg.version                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.backend               = sqlalchemy {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.connection            = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.connection_debug      = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.connection_parameters =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.connection_recycle_time = 3600 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.connection_trace      = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.db_inc_retry_interval = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.db_max_retries        = 20 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.db_max_retry_interval = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.db_retry_interval     = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.max_overflow          = 50 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.max_pool_size         = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.max_retries           = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.mysql_enable_ndb      = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.mysql_wsrep_sync_wait = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.pool_timeout          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.retry_interval        = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.slave_connection      = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] database.sqlite_synchronous    = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.backend           = sqlalchemy {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.connection        = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.connection_debug  = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.connection_parameters =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.connection_recycle_time = 3600 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.connection_trace  = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.db_inc_retry_interval = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.db_max_retries    = 20 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.db_max_retry_interval = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.db_retry_interval = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.max_overflow      = 50 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.max_pool_size     = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.max_retries       = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.mysql_enable_ndb  = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.pool_timeout      = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.retry_interval    = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.slave_connection  = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] api_database.sqlite_synchronous = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] devices.enabled_mdev_types     = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ephemeral_storage_encryption.enabled = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.api_servers             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.cafile                  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.certfile                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.collect_timing          = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.connect_retries         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.connect_retry_delay     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.debug                   = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.default_trusted_certificate_ids = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.enable_certificate_validation = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.enable_rbd_download     = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.endpoint_override       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.insecure                = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.keyfile                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.max_version             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.min_version             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.num_retries             = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.rbd_ceph_conf           =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.rbd_connect_timeout     = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.rbd_pool                =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.rbd_user                =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.region_name             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.service_name            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.service_type            = image {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.split_loggers           = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.status_code_retries     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.status_code_retry_delay = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.timeout                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.verify_glance_signatures = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] glance.version                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] guestfs.debug                  = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.config_drive_cdrom      = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.config_drive_inject_password = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.enable_remotefx         = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.instances_path_share    =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.limit_cpu_features      = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.use_multipath_io        = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.vswitch_name            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] mks.enabled                    = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] image_cache.manager_interval   = 2400 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] image_cache.precache_concurrency = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] image_cache.remove_unused_base_images = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] image_cache.subdirectory_name  = _base {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.api_max_retries         = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.api_retry_interval      = 2 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.auth_section            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.auth_type               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.cafile                  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.certfile                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.collect_timing          = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.connect_retries         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.connect_retry_delay     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.endpoint_override       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.insecure                = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.keyfile                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.max_version             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.min_version             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.partition_key           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.peer_list               = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.region_name             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.serial_console_state_timeout = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.service_name            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.service_type            = baremetal {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.split_loggers           = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.status_code_retries     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.status_code_retry_delay = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.timeout                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ironic.version                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] key_manager.fixed_key          = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.barbican_api_version  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.barbican_endpoint     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.barbican_endpoint_type = public {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.barbican_region_name  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.cafile                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.certfile              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.collect_timing        = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.insecure              = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.keyfile               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.number_of_retries     = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.retry_delay           = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.send_service_user_token = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.split_loggers         = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.timeout               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.verify_ssl            = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican.verify_ssl_path       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican_service_user.auth_section = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican_service_user.auth_type = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican_service_user.cafile   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican_service_user.certfile = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican_service_user.collect_timing = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican_service_user.insecure = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican_service_user.keyfile  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican_service_user.split_loggers = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] barbican_service_user.timeout  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.approle_role_id          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.approle_secret_id        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.cafile                   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.certfile                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.collect_timing           = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.insecure                 = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.keyfile                  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.kv_mountpoint            = secret {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.kv_version               = 2 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.namespace                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.root_token_id            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.split_loggers            = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.ssl_ca_crt_file          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.timeout                  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.use_ssl                  = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.cafile                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:03 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.certfile              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.collect_timing        = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.connect_retries       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.connect_retry_delay   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.endpoint_override     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.insecure              = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.keyfile               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.max_version           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.min_version           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.region_name           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.service_name          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.service_type          = identity {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.split_loggers         = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.status_code_retries   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.status_code_retry_delay = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.timeout               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] keystone.version               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.connection_uri         =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.cpu_mode               = custom {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: WARNING oslo_config.cfg [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.cpu_power_governor_high = performance {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.cpu_power_management   = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.device_detach_attempts = 8 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.device_detach_timeout  = 20 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.disk_cachemodes        = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.disk_prefix            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.enabled_perf_events    = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.file_backed_memory     = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.gid_maps               = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.hw_disk_discard        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.hw_machine_type        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.images_rbd_pool        = rbd {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.images_type            = default {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.images_volume_group    = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.inject_key             = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.inject_partition       = -2 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.inject_password        = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.iscsi_iface            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.iser_use_multipath     = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_downtime = 500 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_inbound_addr = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_scheme  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_timeout_action = abort {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_tunnelled = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: WARNING oslo_config.cfg [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 16 17:56:04 user nova-compute[72000]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 16 17:56:04 user nova-compute[72000]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 16 17:56:04 user nova-compute[72000]: and ``live_migration_inbound_addr`` respectively.
Aug 16 17:56:04 user nova-compute[72000]: ).  Its value may be silently ignored in the future.
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.live_migration_with_native_tls = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.max_queues             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.nfs_mount_options      = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.num_pcie_ports         = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.pmem_namespaces        = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.quobyte_client_cfg     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.rbd_secret_uuid        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.rbd_user               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.rescue_image_id        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.rescue_kernel_id       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.rx_queue_size          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.smbfs_mount_options    =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.snapshot_compression   = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.snapshot_image_format  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.sparse_logical_volumes = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.swtpm_enabled          = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.swtpm_group            = tss {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.swtpm_user             = tss {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.sysinfo_serial         = unique {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.tb_cache_size          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.tx_queue_size          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.uid_maps               = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.use_virtio_for_bridges = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.virt_type              = kvm {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.volume_clear           = zero {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.volume_clear_size      = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.volume_use_multipath   = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.vzstorage_cache_path   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.auth_section           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.auth_type              = password {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.cafile                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.certfile               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.collect_timing         = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.connect_retries        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.connect_retry_delay    = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.default_floating_pool  = public {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.endpoint_override      = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.extension_sync_interval = 600 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.http_retries           = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.insecure               = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.keyfile                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.max_version            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.min_version            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.ovs_bridge             = br-int {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.physnets               = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.region_name            = RegionOne {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.service_metadata_proxy = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.service_name           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.service_type           = network {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.split_loggers          = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.status_code_retries    = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.status_code_retry_delay = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.timeout                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] neutron.version                = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] notifications.bdms_in_notifications = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] notifications.default_level    = INFO {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] notifications.notification_format = unversioned {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] notifications.notify_on_state_change = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] pci.alias                      = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] pci.device_spec                = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] pci.report_in_placement        = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.auth_section         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.auth_type            = password {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.cafile               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.certfile             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.collect_timing       = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.connect_retries      = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.connect_retry_delay  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.default_domain_id    = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.default_domain_name  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.domain_id            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.domain_name          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.endpoint_override    = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.insecure             = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.keyfile              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.max_version          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.min_version          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.password             = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.project_domain_id    = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.project_domain_name  = Default {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.project_id           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.project_name         = service {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.region_name          = RegionOne {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.service_name         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.service_type         = placement {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.split_loggers        = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.status_code_retries  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.status_code_retry_delay = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.system_scope         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.timeout              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.trust_id             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.user_domain_id       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.user_domain_name     = Default {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.user_id              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.username             = placement {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] placement.version              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.cores                    = 20 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.count_usage_from_placement = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.injected_file_content_bytes = 10240 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.injected_file_path_length = 255 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.injected_files           = 5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.instances                = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.key_pairs                = 100 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.metadata_items           = 128 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.ram                      = 51200 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.recheck_quota            = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.server_group_members     = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] quota.server_groups            = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] rdp.enabled                    = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.image_metadata_prefilter = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.max_attempts         = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.max_placement_results = 1000 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] scheduler.workers              = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.host_subset_size = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.isolated_hosts = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.isolated_images = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.pci_in_placement = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.track_instance_changes = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] metrics.required               = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] metrics.weight_multiplier      = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] metrics.weight_setting         = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] serial_console.enabled         = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] serial_console.port_range      = 10000:20000 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] serial_console.serialproxy_port = 6083 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_user.auth_section      = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_user.auth_type         = password {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_user.cafile            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_user.certfile          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_user.collect_timing    = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_user.insecure          = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_user.keyfile           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_user.send_service_user_token = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_user.split_loggers     = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] service_user.timeout           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.agent_enabled            = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.enabled                  = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.html5proxy_port          = 6082 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.image_compression        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.jpeg_compression         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.playback_compression     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.server_listen            = 127.0.0.1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.streaming_mode           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] spice.zlib_compression         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] upgrade_levels.baseapi         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] upgrade_levels.cert            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] upgrade_levels.compute         = auto {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] upgrade_levels.conductor       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] upgrade_levels.scheduler       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vendordata_dynamic_auth.cafile = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vendordata_dynamic_auth.certfile = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vendordata_dynamic_auth.insecure = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vendordata_dynamic_auth.timeout = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.api_retry_count         = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.ca_file                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.cache_prefix            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.cluster_name            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.connection_pool_size    = 10 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.console_delay_seconds   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.datastore_regex         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.host_ip                 = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.host_password           = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.host_port               = 443 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.host_username           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.insecure                = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.integration_bridge      = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.maximum_objects         = 100 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.pbm_default_policy      = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.pbm_enabled             = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.pbm_wsdl_location       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.serial_port_proxy_uri   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.serial_port_service_uri = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.task_poll_interval      = 0.5 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.use_linked_clone        = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.vnc_keymap              = en-us {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.vnc_port                = 5900 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vmware.vnc_port_total          = 10000 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vnc.auth_schemes               = ['none'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vnc.enabled                    = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vnc.novncproxy_port            = 6080 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vnc.vencrypt_ca_certs          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vnc.vencrypt_client_cert       = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vnc.vencrypt_client_key        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.disable_rootwrap   = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.enable_numa_live_migration = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.libvirt_disable_apic = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.client_socket_timeout     = 900 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.default_pool_size         = 1000 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.keep_alive                = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.max_header_line           = 16384 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.ssl_ca_file               = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.ssl_cert_file             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.ssl_key_file              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.tcp_keepidle              = 600 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] zvm.ca_file                    = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] zvm.cloud_connector_url        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] zvm.reachable_timeout          = 300 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_policy.enforce_new_defaults = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_policy.enforce_scope      = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_policy.policy_default_rule = default {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.connection_string     = messaging:// {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.enabled               = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.es_doc_type           = notification {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.es_scroll_size        = 10000 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.es_scroll_time        = 2m {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.filter_error_trace    = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.hmac_keys             = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.sentinel_service_name = mymaster {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.socket_timeout        = 0.1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.trace_requests        = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler.trace_sqlalchemy      = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler_jaeger.process_tags   = {} {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler_jaeger.service_name_prefix = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] profiler_otlp.service_name_prefix = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] remote_debug.host              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] remote_debug.port              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_notifications.retry = -1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.auth_section        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.auth_type           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.cafile              = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.certfile            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.collect_timing      = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.connect_retries     = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.connect_retry_delay = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.endpoint_id         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.endpoint_override   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.insecure            = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.keyfile             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.max_version         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.min_version         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.region_name         = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.service_name        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.service_type        = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.split_loggers       = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.status_code_retries = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.status_code_retry_delay = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.timeout             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.valid_interfaces    = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_limit.version             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_reports.file_event_handler = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] oslo_reports.log_dir           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_ovs_privileged.group  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] vif_plug_ovs_privileged.user   = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_ovs.isolate_vif         = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] os_brick.lock_path             = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] privsep_osbrick.capabilities   = [21] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] privsep_osbrick.group          = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] privsep_osbrick.helper_command = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] privsep_osbrick.user           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] nova_sys_admin.group           = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] nova_sys_admin.helper_command  = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] nova_sys_admin.user            = None {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG oslo_service.service [None req-f1d4e455-c837-48a2-a3d1-f29aa4f6a589 None None] ******************************************************************************** {{(pid=72000) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 16 17:56:04 user nova-compute[72000]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 16 17:56:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Starting native event thread {{(pid=72000) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Starting green dispatch thread {{(pid=72000) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Starting connection event dispatch thread {{(pid=72000) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Connecting to libvirt: qemu:///system {{(pid=72000) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd0186fcdc0> {{(pid=72000) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 16 17:56:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd0186fcdc0> {{(pid=72000) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 16 17:56:04 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Connection event '1' reason 'None'
Aug 16 17:56:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 17:56:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.mount [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Initialising _HostMountState generation 0 {{(pid=72000) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 16 17:56:11 user nova-compute[72000]: INFO nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Libvirt host capabilities <capabilities>
Aug 16 17:56:11 user nova-compute[72000]:   <host>
Aug 16 17:56:11 user nova-compute[72000]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 16 17:56:11 user nova-compute[72000]:     <cpu>
Aug 16 17:56:11 user nova-compute[72000]:       <arch>x86_64</arch>
Aug 16 17:56:11 user nova-compute[72000]:       <model>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <vendor>Intel</vendor>
Aug 16 17:56:11 user nova-compute[72000]:       <microcode version='1070'/>
Aug 16 17:56:11 user nova-compute[72000]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 16 17:56:11 user nova-compute[72000]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='ss'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='vmx'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='pcid'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='osxsave'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='hypervisor'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='arat'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='tsc_adjust'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='md-clear'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='arch-capabilities'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='invtsc'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='rsba'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature name='skip-l1dfl-vmentry'/>
Aug 16 17:56:11 user nova-compute[72000]:       <pages unit='KiB' size='4'/>
Aug 16 17:56:11 user nova-compute[72000]:       <pages unit='KiB' size='2048'/>
Aug 16 17:56:11 user nova-compute[72000]:     </cpu>
Aug 16 17:56:11 user nova-compute[72000]:     <power_management>
Aug 16 17:56:11 user nova-compute[72000]:       <suspend_mem/>
Aug 16 17:56:11 user nova-compute[72000]:       <suspend_disk/>
Aug 16 17:56:11 user nova-compute[72000]:       <suspend_hybrid/>
Aug 16 17:56:11 user nova-compute[72000]:     </power_management>
Aug 16 17:56:11 user nova-compute[72000]:     <iommu support='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     <migration_features>
Aug 16 17:56:11 user nova-compute[72000]:       <live/>
Aug 16 17:56:11 user nova-compute[72000]:       <uri_transports>
Aug 16 17:56:11 user nova-compute[72000]:         <uri_transport>tcp</uri_transport>
Aug 16 17:56:11 user nova-compute[72000]:         <uri_transport>rdma</uri_transport>
Aug 16 17:56:11 user nova-compute[72000]:       </uri_transports>
Aug 16 17:56:11 user nova-compute[72000]:     </migration_features>
Aug 16 17:56:11 user nova-compute[72000]:     <topology>
Aug 16 17:56:11 user nova-compute[72000]:       <cells num='2'>
Aug 16 17:56:11 user nova-compute[72000]:         <cell id='0'>
Aug 16 17:56:11 user nova-compute[72000]:           <memory unit='KiB'>8189224</memory>
Aug 16 17:56:11 user nova-compute[72000]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 16 17:56:11 user nova-compute[72000]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 17:56:11 user nova-compute[72000]:           <distances>
Aug 16 17:56:11 user nova-compute[72000]:             <sibling id='0' value='10'/>
Aug 16 17:56:11 user nova-compute[72000]:             <sibling id='1' value='20'/>
Aug 16 17:56:11 user nova-compute[72000]:           </distances>
Aug 16 17:56:11 user nova-compute[72000]:           <cpus num='6'>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 16 17:56:11 user nova-compute[72000]:           </cpus>
Aug 16 17:56:11 user nova-compute[72000]:         </cell>
Aug 16 17:56:11 user nova-compute[72000]:         <cell id='1'>
Aug 16 17:56:11 user nova-compute[72000]:           <memory unit='KiB'>8206492</memory>
Aug 16 17:56:11 user nova-compute[72000]:           <pages unit='KiB' size='4'>2051623</pages>
Aug 16 17:56:11 user nova-compute[72000]:           <pages unit='KiB' size='2048'>0</pages>
Aug 16 17:56:11 user nova-compute[72000]:           <distances>
Aug 16 17:56:11 user nova-compute[72000]:             <sibling id='0' value='20'/>
Aug 16 17:56:11 user nova-compute[72000]:             <sibling id='1' value='10'/>
Aug 16 17:56:11 user nova-compute[72000]:           </distances>
Aug 16 17:56:11 user nova-compute[72000]:           <cpus num='6'>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 16 17:56:11 user nova-compute[72000]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 16 17:56:11 user nova-compute[72000]:           </cpus>
Aug 16 17:56:11 user nova-compute[72000]:         </cell>
Aug 16 17:56:11 user nova-compute[72000]:       </cells>
Aug 16 17:56:11 user nova-compute[72000]:     </topology>
Aug 16 17:56:11 user nova-compute[72000]:     <cache>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 16 17:56:11 user nova-compute[72000]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 16 17:56:11 user nova-compute[72000]:     </cache>
Aug 16 17:56:11 user nova-compute[72000]:     <secmodel>
Aug 16 17:56:11 user nova-compute[72000]:       <model>apparmor</model>
Aug 16 17:56:11 user nova-compute[72000]:       <doi>0</doi>
Aug 16 17:56:11 user nova-compute[72000]:     </secmodel>
Aug 16 17:56:11 user nova-compute[72000]:     <secmodel>
Aug 16 17:56:11 user nova-compute[72000]:       <model>dac</model>
Aug 16 17:56:11 user nova-compute[72000]:       <doi>0</doi>
Aug 16 17:56:11 user nova-compute[72000]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 16 17:56:11 user nova-compute[72000]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 16 17:56:11 user nova-compute[72000]:     </secmodel>
Aug 16 17:56:11 user nova-compute[72000]:   </host>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='alpha'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>clipper</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='armv6l'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>spitz</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>nuri</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>kzm</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sx1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>z2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>tosa</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>n810</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>n800</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>terrier</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>midway</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>microbit</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>verdex</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>highbank</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>akita</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>connex</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>collie</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='armv7l'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>spitz</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>nuri</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>kzm</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sx1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>z2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>tosa</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>n810</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>n800</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>terrier</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>midway</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>microbit</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>verdex</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>highbank</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>akita</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>connex</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>collie</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='aarch64'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>integratorcp</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>borzoi</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>spitz</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>nuri</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>musca-b1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>versatileab</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>kzm</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>musca-a</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>smdkc210</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sx1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>z2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>tosa</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>sabrelite</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>realview-eb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>n810</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>n800</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>versatilepb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>terrier</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mainstone</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>midway</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>musicpal</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>microbit</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>cubieboard</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>verdex</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>netduino2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>raspi3b</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>raspi2b</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>cheetah</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>highbank</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>akita</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>connex</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>collie</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>raspi0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <acpi default='on' toggle='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='cris'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='i686'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>isapc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>microvm</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='kvm'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <pae/>
Aug 16 17:56:11 user nova-compute[72000]:       <nonpae/>
Aug 16 17:56:11 user nova-compute[72000]:       <acpi default='on' toggle='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:       <apic default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='m68k'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>an5206</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>q800</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>next-cube</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='microblaze'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='microblazeel'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='mips'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='16'>malta</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='mipsel'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='16'>malta</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='mips64'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='16'>malta</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>pica61</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>magnum</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='mips64el'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='16'>malta</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mipssim</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>pica61</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>magnum</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='16'>boston</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='ppc'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mac99</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>40p</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>taihu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='ppc64'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>taihu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>40p</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mac99</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='ppc64le'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2048'>powernv9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>taihu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2048'>powernv10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>ppce500</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>40p</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>pegasos2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>bamboo</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>g3beige</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>mac99</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sam460ex</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>ref405ep</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2048'>powernv8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='riscv32'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='8'>spike</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>opentitan</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='8'>virt</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='riscv64'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='8'>spike</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='5'>sifive_u</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>shakti_c</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sifive_e</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='8'>virt</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='s390x'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='sh4'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>shix</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>r2d</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='sh4eb'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>shix</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>r2d</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='sparc'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>SS-5</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>SS-20</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>LX</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>SS-4</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>SS-10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>Voyager</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='sparc64'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sun4u</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>niagara</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>sun4v</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='x86_64'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>64</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>x-remote</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='1'>isapc</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>microvm</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='kvm'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <acpi default='on' toggle='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:       <apic default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='xtensa'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>sim</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>kc705</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>ml605</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>virt</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>lx200</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>lx60</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]:   <guest>
Aug 16 17:56:11 user nova-compute[72000]:     <os_type>hvm</os_type>
Aug 16 17:56:11 user nova-compute[72000]:     <arch name='xtensaeb'>
Aug 16 17:56:11 user nova-compute[72000]:       <wordsize>32</wordsize>
Aug 16 17:56:11 user nova-compute[72000]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='4'>sim</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>kc705</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>ml605</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>virt</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>lx200</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>lx60</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 16 17:56:11 user nova-compute[72000]:       <domain type='qemu'/>
Aug 16 17:56:11 user nova-compute[72000]:     </arch>
Aug 16 17:56:11 user nova-compute[72000]:     <features>
Aug 16 17:56:11 user nova-compute[72000]:       <cpuselection/>
Aug 16 17:56:11 user nova-compute[72000]:       <deviceboot/>
Aug 16 17:56:11 user nova-compute[72000]:       <disksnapshot default='on' toggle='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     </features>
Aug 16 17:56:11 user nova-compute[72000]:   </guest>
Aug 16 17:56:11 user nova-compute[72000]: </capabilities>
Aug 16 17:56:11 user nova-compute[72000]: 
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 16 17:56:11 user nova-compute[72000]: <domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 17:56:11 user nova-compute[72000]:   <domain>kvm</domain>
Aug 16 17:56:11 user nova-compute[72000]:   <machine>pc-q35-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:   <arch>i686</arch>
Aug 16 17:56:11 user nova-compute[72000]:   <vcpu max='288'/>
Aug 16 17:56:11 user nova-compute[72000]:   <iothreads supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:   <os supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='firmware'/>
Aug 16 17:56:11 user nova-compute[72000]:     <loader supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>rom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pflash</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='readonly'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>yes</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='secure'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </loader>
Aug 16 17:56:11 user nova-compute[72000]:   </os>
Aug 16 17:56:11 user nova-compute[72000]:   <cpu>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-passthrough' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='hostPassthroughMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='maximum' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='maximumMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-model' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <vendor>Intel</vendor>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ss'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='vmx'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pcid'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='hypervisor'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arat'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='umip'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='md-clear'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibpb'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibrs'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='erms'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='lm'/>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='custom' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>qemu64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>qemu32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>phenom</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>n270</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>kvm64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>coreduo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>core2duo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>athlon</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Westmere</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Snowridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Penryn</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G5</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G4</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G1</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Nehalem</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Rome</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Milan</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Dhyana</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cooperlake</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Conroe</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>486</model>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:   </cpu>
Aug 16 17:56:11 user nova-compute[72000]:   <memoryBacking supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='sourceType'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>file</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>anonymous</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>memfd</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:   </memoryBacking>
Aug 16 17:56:11 user nova-compute[72000]:   <devices>
Aug 16 17:56:11 user nova-compute[72000]:     <disk supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='diskDevice'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>disk</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cdrom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>floppy</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>lun</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='bus'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>fdc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sata</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </disk>
Aug 16 17:56:11 user nova-compute[72000]:     <graphics supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sdl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vnc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>spice</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egl-headless</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </graphics>
Aug 16 17:56:11 user nova-compute[72000]:     <video supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='modelType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cirrus</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vmvga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>qxl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>none</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>bochs</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ramfb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </video>
Aug 16 17:56:11 user nova-compute[72000]:     <hostdev supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='mode'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>subsystem</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='startupPolicy'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>default</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>mandatory</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>requisite</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>optional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='subsysType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pci</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='capsType'/>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='pciBackend'/>
Aug 16 17:56:11 user nova-compute[72000]:     </hostdev>
Aug 16 17:56:11 user nova-compute[72000]:     <rng supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>random</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egd</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>builtin</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </rng>
Aug 16 17:56:11 user nova-compute[72000]:     <filesystem supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='driverType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>path</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>handle</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtiofs</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </filesystem>
Aug 16 17:56:11 user nova-compute[72000]:     <tpm supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-tis</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-crb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>passthrough</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>emulator</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </tpm>
Aug 16 17:56:11 user nova-compute[72000]:   </devices>
Aug 16 17:56:11 user nova-compute[72000]:   <features>
Aug 16 17:56:11 user nova-compute[72000]:     <gic supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     <vmcoreinfo supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <genid supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backingStoreInput supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backup supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <sev supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:   </features>
Aug 16 17:56:11 user nova-compute[72000]: </domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:  {{(pid=72000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 16 17:56:11 user nova-compute[72000]: <domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 17:56:11 user nova-compute[72000]:   <domain>kvm</domain>
Aug 16 17:56:11 user nova-compute[72000]:   <machine>pc-i440fx-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:   <arch>i686</arch>
Aug 16 17:56:11 user nova-compute[72000]:   <vcpu max='255'/>
Aug 16 17:56:11 user nova-compute[72000]:   <iothreads supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:   <os supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='firmware'/>
Aug 16 17:56:11 user nova-compute[72000]:     <loader supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>rom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pflash</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='readonly'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>yes</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='secure'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </loader>
Aug 16 17:56:11 user nova-compute[72000]:   </os>
Aug 16 17:56:11 user nova-compute[72000]:   <cpu>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-passthrough' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='hostPassthroughMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='maximum' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='maximumMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-model' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <vendor>Intel</vendor>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ss'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='vmx'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pcid'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='hypervisor'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arat'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='umip'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='md-clear'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibpb'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibrs'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='erms'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='lm'/>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='custom' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>qemu64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>qemu32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>phenom</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>n270</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>kvm64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>coreduo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>core2duo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>athlon</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Westmere</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Snowridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Penryn</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G5</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G4</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G1</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Nehalem</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Rome</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Milan</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Dhyana</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cooperlake</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Conroe</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>486</model>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:   </cpu>
Aug 16 17:56:11 user nova-compute[72000]:   <memoryBacking supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='sourceType'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>file</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>anonymous</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>memfd</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:   </memoryBacking>
Aug 16 17:56:11 user nova-compute[72000]:   <devices>
Aug 16 17:56:11 user nova-compute[72000]:     <disk supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='diskDevice'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>disk</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cdrom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>floppy</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>lun</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='bus'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ide</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>fdc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sata</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </disk>
Aug 16 17:56:11 user nova-compute[72000]:     <graphics supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sdl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vnc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>spice</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egl-headless</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </graphics>
Aug 16 17:56:11 user nova-compute[72000]:     <video supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='modelType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cirrus</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vmvga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>qxl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>none</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>bochs</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ramfb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </video>
Aug 16 17:56:11 user nova-compute[72000]:     <hostdev supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='mode'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>subsystem</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='startupPolicy'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>default</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>mandatory</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>requisite</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>optional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='subsysType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pci</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='capsType'/>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='pciBackend'/>
Aug 16 17:56:11 user nova-compute[72000]:     </hostdev>
Aug 16 17:56:11 user nova-compute[72000]:     <rng supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>random</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egd</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>builtin</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </rng>
Aug 16 17:56:11 user nova-compute[72000]:     <filesystem supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='driverType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>path</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>handle</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtiofs</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </filesystem>
Aug 16 17:56:11 user nova-compute[72000]:     <tpm supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-tis</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-crb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>passthrough</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>emulator</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </tpm>
Aug 16 17:56:11 user nova-compute[72000]:   </devices>
Aug 16 17:56:11 user nova-compute[72000]:   <features>
Aug 16 17:56:11 user nova-compute[72000]:     <gic supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     <vmcoreinfo supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <genid supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backingStoreInput supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backup supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <sev supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:   </features>
Aug 16 17:56:11 user nova-compute[72000]: </domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:  {{(pid=72000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 16 17:56:11 user nova-compute[72000]: <domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 17:56:11 user nova-compute[72000]:   <domain>kvm</domain>
Aug 16 17:56:11 user nova-compute[72000]:   <machine>pc-q35-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:   <arch>i686</arch>
Aug 16 17:56:11 user nova-compute[72000]:   <vcpu max='288'/>
Aug 16 17:56:11 user nova-compute[72000]:   <iothreads supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:   <os supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='firmware'/>
Aug 16 17:56:11 user nova-compute[72000]:     <loader supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>rom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pflash</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='readonly'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>yes</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='secure'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </loader>
Aug 16 17:56:11 user nova-compute[72000]:   </os>
Aug 16 17:56:11 user nova-compute[72000]:   <cpu>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-passthrough' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='hostPassthroughMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='maximum' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='maximumMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-model' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <vendor>Intel</vendor>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ss'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='vmx'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pcid'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='hypervisor'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arat'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='umip'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='md-clear'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibpb'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibrs'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='erms'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='lm'/>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='custom' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>qemu64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>qemu32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>phenom</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>n270</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>kvm64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>coreduo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>core2duo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>athlon</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Westmere</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Snowridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Penryn</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G5</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G4</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G1</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Nehalem</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Rome</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Milan</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Dhyana</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cooperlake</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Conroe</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>486</model>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:   </cpu>
Aug 16 17:56:11 user nova-compute[72000]:   <memoryBacking supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='sourceType'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>file</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>anonymous</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>memfd</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:   </memoryBacking>
Aug 16 17:56:11 user nova-compute[72000]:   <devices>
Aug 16 17:56:11 user nova-compute[72000]:     <disk supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='diskDevice'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>disk</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cdrom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>floppy</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>lun</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='bus'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>fdc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sata</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </disk>
Aug 16 17:56:11 user nova-compute[72000]:     <graphics supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sdl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vnc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>spice</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egl-headless</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </graphics>
Aug 16 17:56:11 user nova-compute[72000]:     <video supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='modelType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cirrus</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vmvga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>qxl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>none</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>bochs</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ramfb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </video>
Aug 16 17:56:11 user nova-compute[72000]:     <hostdev supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='mode'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>subsystem</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='startupPolicy'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>default</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>mandatory</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>requisite</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>optional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='subsysType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pci</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='capsType'/>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='pciBackend'/>
Aug 16 17:56:11 user nova-compute[72000]:     </hostdev>
Aug 16 17:56:11 user nova-compute[72000]:     <rng supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>random</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egd</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>builtin</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </rng>
Aug 16 17:56:11 user nova-compute[72000]:     <filesystem supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='driverType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>path</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>handle</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtiofs</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </filesystem>
Aug 16 17:56:11 user nova-compute[72000]:     <tpm supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-tis</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-crb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>passthrough</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>emulator</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </tpm>
Aug 16 17:56:11 user nova-compute[72000]:   </devices>
Aug 16 17:56:11 user nova-compute[72000]:   <features>
Aug 16 17:56:11 user nova-compute[72000]:     <gic supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     <vmcoreinfo supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <genid supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backingStoreInput supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backup supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <sev supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:   </features>
Aug 16 17:56:11 user nova-compute[72000]: </domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:  {{(pid=72000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 16 17:56:11 user nova-compute[72000]: <domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:   <path>/usr/bin/qemu-system-i386</path>
Aug 16 17:56:11 user nova-compute[72000]:   <domain>kvm</domain>
Aug 16 17:56:11 user nova-compute[72000]:   <machine>pc-i440fx-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:   <arch>i686</arch>
Aug 16 17:56:11 user nova-compute[72000]:   <vcpu max='255'/>
Aug 16 17:56:11 user nova-compute[72000]:   <iothreads supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:   <os supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='firmware'/>
Aug 16 17:56:11 user nova-compute[72000]:     <loader supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>rom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pflash</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='readonly'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>yes</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='secure'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </loader>
Aug 16 17:56:11 user nova-compute[72000]:   </os>
Aug 16 17:56:11 user nova-compute[72000]:   <cpu>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-passthrough' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='hostPassthroughMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='maximum' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='maximumMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-model' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <vendor>Intel</vendor>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ss'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='vmx'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pcid'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='hypervisor'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arat'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='umip'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='md-clear'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibpb'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibrs'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='erms'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='lm'/>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='custom' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>qemu64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>qemu32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>phenom</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>n270</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>kvm64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>coreduo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>core2duo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>athlon</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Westmere-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Westmere</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Snowridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Penryn</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G5</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G4</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G1</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Nehalem-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Nehalem</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Rome</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Milan</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Dhyana</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cooperlake</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Conroe</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>486</model>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:   </cpu>
Aug 16 17:56:11 user nova-compute[72000]:   <memoryBacking supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='sourceType'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>file</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>anonymous</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>memfd</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:   </memoryBacking>
Aug 16 17:56:11 user nova-compute[72000]:   <devices>
Aug 16 17:56:11 user nova-compute[72000]:     <disk supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='diskDevice'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>disk</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cdrom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>floppy</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>lun</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='bus'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ide</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>fdc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sata</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </disk>
Aug 16 17:56:11 user nova-compute[72000]:     <graphics supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sdl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vnc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>spice</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egl-headless</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </graphics>
Aug 16 17:56:11 user nova-compute[72000]:     <video supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='modelType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cirrus</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vmvga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>qxl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>none</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>bochs</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ramfb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </video>
Aug 16 17:56:11 user nova-compute[72000]:     <hostdev supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='mode'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>subsystem</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='startupPolicy'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>default</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>mandatory</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>requisite</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>optional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='subsysType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pci</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='capsType'/>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='pciBackend'/>
Aug 16 17:56:11 user nova-compute[72000]:     </hostdev>
Aug 16 17:56:11 user nova-compute[72000]:     <rng supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>random</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egd</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>builtin</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </rng>
Aug 16 17:56:11 user nova-compute[72000]:     <filesystem supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='driverType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>path</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>handle</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtiofs</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </filesystem>
Aug 16 17:56:11 user nova-compute[72000]:     <tpm supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-tis</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-crb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>passthrough</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>emulator</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </tpm>
Aug 16 17:56:11 user nova-compute[72000]:   </devices>
Aug 16 17:56:11 user nova-compute[72000]:   <features>
Aug 16 17:56:11 user nova-compute[72000]:     <gic supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     <vmcoreinfo supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <genid supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backingStoreInput supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backup supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <sev supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:   </features>
Aug 16 17:56:11 user nova-compute[72000]: </domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:  {{(pid=72000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 16 17:56:11 user nova-compute[72000]: <domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 17:56:11 user nova-compute[72000]:   <domain>kvm</domain>
Aug 16 17:56:11 user nova-compute[72000]:   <machine>pc-q35-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:   <arch>x86_64</arch>
Aug 16 17:56:11 user nova-compute[72000]:   <vcpu max='288'/>
Aug 16 17:56:11 user nova-compute[72000]:   <iothreads supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:   <os supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='firmware'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>efi</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:     <loader supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>rom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pflash</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='readonly'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>yes</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='secure'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>yes</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </loader>
Aug 16 17:56:11 user nova-compute[72000]:   </os>
Aug 16 17:56:11 user nova-compute[72000]:   <cpu>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-passthrough' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='hostPassthroughMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='maximum' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='maximumMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-model' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <vendor>Intel</vendor>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ss'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='vmx'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pcid'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='hypervisor'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arat'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='umip'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='md-clear'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='invtsc'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibpb'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibrs'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='rsba'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='erms'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='custom' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>qemu64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>qemu32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>phenom</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>n270</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>coreduo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>core2duo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>athlon</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Westmere</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Snowridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Penryn</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G5</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G4</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Opteron_G1</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Nehalem</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Rome</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Milan</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Dhyana</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cooperlake</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Conroe</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>486</model>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:   </cpu>
Aug 16 17:56:11 user nova-compute[72000]:   <memoryBacking supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='sourceType'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>file</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>anonymous</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>memfd</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:   </memoryBacking>
Aug 16 17:56:11 user nova-compute[72000]:   <devices>
Aug 16 17:56:11 user nova-compute[72000]:     <disk supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='diskDevice'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>disk</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cdrom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>floppy</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>lun</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='bus'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>fdc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sata</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </disk>
Aug 16 17:56:11 user nova-compute[72000]:     <graphics supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sdl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vnc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>spice</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egl-headless</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </graphics>
Aug 16 17:56:11 user nova-compute[72000]:     <video supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='modelType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cirrus</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vmvga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>qxl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>none</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>bochs</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ramfb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </video>
Aug 16 17:56:11 user nova-compute[72000]:     <hostdev supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='mode'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>subsystem</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='startupPolicy'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>default</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>mandatory</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>requisite</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>optional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='subsysType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pci</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='capsType'/>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='pciBackend'/>
Aug 16 17:56:11 user nova-compute[72000]:     </hostdev>
Aug 16 17:56:11 user nova-compute[72000]:     <rng supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>random</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egd</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>builtin</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </rng>
Aug 16 17:56:11 user nova-compute[72000]:     <filesystem supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='driverType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>path</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>handle</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtiofs</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </filesystem>
Aug 16 17:56:11 user nova-compute[72000]:     <tpm supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-tis</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-crb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>passthrough</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>emulator</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </tpm>
Aug 16 17:56:11 user nova-compute[72000]:   </devices>
Aug 16 17:56:11 user nova-compute[72000]:   <features>
Aug 16 17:56:11 user nova-compute[72000]:     <gic supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     <vmcoreinfo supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <genid supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backingStoreInput supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backup supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <sev supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:   </features>
Aug 16 17:56:11 user nova-compute[72000]: </domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:  {{(pid=72000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 16 17:56:11 user nova-compute[72000]: <domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 17:56:11 user nova-compute[72000]:   <domain>kvm</domain>
Aug 16 17:56:11 user nova-compute[72000]:   <machine>pc-i440fx-jammy</machine>
Aug 16 17:56:11 user nova-compute[72000]:   <arch>x86_64</arch>
Aug 16 17:56:11 user nova-compute[72000]:   <vcpu max='255'/>
Aug 16 17:56:11 user nova-compute[72000]:   <iothreads supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:   <os supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='firmware'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>efi</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:     <loader supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>rom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pflash</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='readonly'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>yes</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='secure'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </loader>
Aug 16 17:56:11 user nova-compute[72000]:   </os>
Aug 16 17:56:11 user nova-compute[72000]:   <cpu>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-passthrough' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='hostPassthroughMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='maximum' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='maximumMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-model' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <vendor>Intel</vendor>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ss'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='vmx'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pcid'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='hypervisor'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arat'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='umip'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='md-clear'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='invtsc'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibpb'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibrs'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='rsba'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='erms'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='custom' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>qemu64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>qemu32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>phenom</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>n270</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>coreduo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>core2duo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>athlon</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Westmere</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Snowridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Penryn</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G5</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G4</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Opteron_G1</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Nehalem</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Rome</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Milan</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Dhyana</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cooperlake</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Conroe</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>486</model>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:   </cpu>
Aug 16 17:56:11 user nova-compute[72000]:   <memoryBacking supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='sourceType'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>file</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>anonymous</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>memfd</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:   </memoryBacking>
Aug 16 17:56:11 user nova-compute[72000]:   <devices>
Aug 16 17:56:11 user nova-compute[72000]:     <disk supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='diskDevice'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>disk</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cdrom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>floppy</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>lun</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='bus'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ide</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>fdc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sata</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </disk>
Aug 16 17:56:11 user nova-compute[72000]:     <graphics supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sdl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vnc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>spice</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egl-headless</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </graphics>
Aug 16 17:56:11 user nova-compute[72000]:     <video supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='modelType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cirrus</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vmvga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>qxl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>none</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>bochs</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ramfb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </video>
Aug 16 17:56:11 user nova-compute[72000]:     <hostdev supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='mode'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>subsystem</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='startupPolicy'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>default</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>mandatory</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>requisite</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>optional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='subsysType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pci</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='capsType'/>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='pciBackend'/>
Aug 16 17:56:11 user nova-compute[72000]:     </hostdev>
Aug 16 17:56:11 user nova-compute[72000]:     <rng supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>random</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egd</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>builtin</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </rng>
Aug 16 17:56:11 user nova-compute[72000]:     <filesystem supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='driverType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>path</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>handle</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtiofs</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </filesystem>
Aug 16 17:56:11 user nova-compute[72000]:     <tpm supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-tis</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-crb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>passthrough</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>emulator</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </tpm>
Aug 16 17:56:11 user nova-compute[72000]:   </devices>
Aug 16 17:56:11 user nova-compute[72000]:   <features>
Aug 16 17:56:11 user nova-compute[72000]:     <gic supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     <vmcoreinfo supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <genid supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backingStoreInput supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backup supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <sev supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:   </features>
Aug 16 17:56:11 user nova-compute[72000]: </domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:  {{(pid=72000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 16 17:56:11 user nova-compute[72000]: <domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 17:56:11 user nova-compute[72000]:   <domain>kvm</domain>
Aug 16 17:56:11 user nova-compute[72000]:   <machine>pc-q35-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:   <arch>x86_64</arch>
Aug 16 17:56:11 user nova-compute[72000]:   <vcpu max='288'/>
Aug 16 17:56:11 user nova-compute[72000]:   <iothreads supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:   <os supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='firmware'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>efi</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:     <loader supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>rom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pflash</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='readonly'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>yes</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='secure'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>yes</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </loader>
Aug 16 17:56:11 user nova-compute[72000]:   </os>
Aug 16 17:56:11 user nova-compute[72000]:   <cpu>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-passthrough' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='hostPassthroughMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='maximum' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='maximumMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-model' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <vendor>Intel</vendor>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ss'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='vmx'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pcid'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='hypervisor'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arat'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='umip'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='md-clear'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='invtsc'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibpb'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibrs'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='rsba'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='erms'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='custom' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>qemu64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>qemu32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>phenom</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>n270</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>coreduo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>core2duo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>athlon</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Westmere</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Snowridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Penryn</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G5</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G4</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Opteron_G1</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Nehalem</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Rome</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Milan</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Dhyana</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cooperlake</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Conroe</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>486</model>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:   </cpu>
Aug 16 17:56:11 user nova-compute[72000]:   <memoryBacking supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='sourceType'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>file</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>anonymous</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>memfd</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:   </memoryBacking>
Aug 16 17:56:11 user nova-compute[72000]:   <devices>
Aug 16 17:56:11 user nova-compute[72000]:     <disk supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='diskDevice'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>disk</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cdrom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>floppy</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>lun</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='bus'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>fdc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sata</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </disk>
Aug 16 17:56:11 user nova-compute[72000]:     <graphics supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sdl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vnc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>spice</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egl-headless</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </graphics>
Aug 16 17:56:11 user nova-compute[72000]:     <video supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='modelType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cirrus</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vmvga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>qxl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>none</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>bochs</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ramfb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </video>
Aug 16 17:56:11 user nova-compute[72000]:     <hostdev supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='mode'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>subsystem</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='startupPolicy'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>default</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>mandatory</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>requisite</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>optional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='subsysType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pci</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='capsType'/>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='pciBackend'/>
Aug 16 17:56:11 user nova-compute[72000]:     </hostdev>
Aug 16 17:56:11 user nova-compute[72000]:     <rng supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>random</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egd</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>builtin</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </rng>
Aug 16 17:56:11 user nova-compute[72000]:     <filesystem supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='driverType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>path</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>handle</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtiofs</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </filesystem>
Aug 16 17:56:11 user nova-compute[72000]:     <tpm supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-tis</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-crb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>passthrough</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>emulator</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </tpm>
Aug 16 17:56:11 user nova-compute[72000]:   </devices>
Aug 16 17:56:11 user nova-compute[72000]:   <features>
Aug 16 17:56:11 user nova-compute[72000]:     <gic supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     <vmcoreinfo supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <genid supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backingStoreInput supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backup supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <sev supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:   </features>
Aug 16 17:56:11 user nova-compute[72000]: </domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:  {{(pid=72000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 16 17:56:11 user nova-compute[72000]: <domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 16 17:56:11 user nova-compute[72000]:   <domain>kvm</domain>
Aug 16 17:56:11 user nova-compute[72000]:   <machine>pc-i440fx-6.2</machine>
Aug 16 17:56:11 user nova-compute[72000]:   <arch>x86_64</arch>
Aug 16 17:56:11 user nova-compute[72000]:   <vcpu max='255'/>
Aug 16 17:56:11 user nova-compute[72000]:   <iothreads supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:   <os supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='firmware'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>efi</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:     <loader supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>rom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pflash</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='readonly'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>yes</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='secure'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>no</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </loader>
Aug 16 17:56:11 user nova-compute[72000]:   </os>
Aug 16 17:56:11 user nova-compute[72000]:   <cpu>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-passthrough' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='hostPassthroughMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='maximum' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='maximumMigratable'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>on</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>off</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='host-model' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <vendor>Intel</vendor>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ss'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='vmx'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pcid'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='hypervisor'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arat'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='tsc_adjust'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='umip'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='md-clear'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='arch-capabilities'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='invtsc'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibpb'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='ibrs'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-stibp'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='amd-ssbd'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='rsba'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='require' name='pschange-mc-no'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='erms'/>
Aug 16 17:56:11 user nova-compute[72000]:       <feature policy='disable' name='xsaveopt'/>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:     <mode name='custom' supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>qemu64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>qemu32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>phenom</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>pentium</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>n270</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm64</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>kvm32</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>coreduo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>core2duo</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>athlon</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Westmere-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Westmere</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Snowridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Skylake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>SandyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Penryn</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G5</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G4</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G3</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Opteron_G2</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Opteron_G1</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Nehalem</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>IvyBridge</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Icelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Haswell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Rome</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-Milan</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC-IBPB</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>EPYC</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Dhyana</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cooperlake</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>Conroe</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Cascadelake-Server</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-noTSX</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell-IBRS</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='no'>Broadwell</model>
Aug 16 17:56:11 user nova-compute[72000]:       <model usable='yes'>486</model>
Aug 16 17:56:11 user nova-compute[72000]:     </mode>
Aug 16 17:56:11 user nova-compute[72000]:   </cpu>
Aug 16 17:56:11 user nova-compute[72000]:   <memoryBacking supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:     <enum name='sourceType'>
Aug 16 17:56:11 user nova-compute[72000]:       <value>file</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>anonymous</value>
Aug 16 17:56:11 user nova-compute[72000]:       <value>memfd</value>
Aug 16 17:56:11 user nova-compute[72000]:     </enum>
Aug 16 17:56:11 user nova-compute[72000]:   </memoryBacking>
Aug 16 17:56:11 user nova-compute[72000]:   <devices>
Aug 16 17:56:11 user nova-compute[72000]:     <disk supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='diskDevice'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>disk</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cdrom</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>floppy</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>lun</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='bus'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ide</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>fdc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sata</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </disk>
Aug 16 17:56:11 user nova-compute[72000]:     <graphics supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='type'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>sdl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vnc</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>spice</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egl-headless</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </graphics>
Aug 16 17:56:11 user nova-compute[72000]:     <video supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='modelType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>cirrus</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>vmvga</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>qxl</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>none</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>bochs</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>ramfb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </video>
Aug 16 17:56:11 user nova-compute[72000]:     <hostdev supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='mode'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>subsystem</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='startupPolicy'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>default</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>mandatory</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>requisite</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>optional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='subsysType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>usb</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>pci</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>scsi</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='capsType'/>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='pciBackend'/>
Aug 16 17:56:11 user nova-compute[72000]:     </hostdev>
Aug 16 17:56:11 user nova-compute[72000]:     <rng supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtio-non-transitional</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>random</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>egd</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>builtin</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </rng>
Aug 16 17:56:11 user nova-compute[72000]:     <filesystem supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='driverType'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>path</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>handle</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>virtiofs</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </filesystem>
Aug 16 17:56:11 user nova-compute[72000]:     <tpm supported='yes'>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='model'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-tis</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>tpm-crb</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:       <enum name='backendModel'>
Aug 16 17:56:11 user nova-compute[72000]:         <value>passthrough</value>
Aug 16 17:56:11 user nova-compute[72000]:         <value>emulator</value>
Aug 16 17:56:11 user nova-compute[72000]:       </enum>
Aug 16 17:56:11 user nova-compute[72000]:     </tpm>
Aug 16 17:56:11 user nova-compute[72000]:   </devices>
Aug 16 17:56:11 user nova-compute[72000]:   <features>
Aug 16 17:56:11 user nova-compute[72000]:     <gic supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:     <vmcoreinfo supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <genid supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backingStoreInput supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <backup supported='yes'/>
Aug 16 17:56:11 user nova-compute[72000]:     <sev supported='no'/>
Aug 16 17:56:11 user nova-compute[72000]:   </features>
Aug 16 17:56:11 user nova-compute[72000]: </domainCapabilities>
Aug 16 17:56:11 user nova-compute[72000]:  {{(pid=72000) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72000) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72000) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Checking secure boot support for host arch (x86_64) {{(pid=72000) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 16 17:56:11 user nova-compute[72000]: INFO nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Secure Boot support detected
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] cpu compare xml: <cpu match="exact">
Aug 16 17:56:11 user nova-compute[72000]:   <model>Nehalem</model>
Aug 16 17:56:11 user nova-compute[72000]: </cpu>
Aug 16 17:56:11 user nova-compute[72000]:  {{(pid=72000) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 16 17:56:11 user nova-compute[72000]: INFO nova.virt.node [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Generated node identity 41d2d9e5-ac93-4703-9b48-d29797f5aeb9
Aug 16 17:56:11 user nova-compute[72000]: INFO nova.virt.node [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Wrote node identity 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 to /opt/stack/data/nova/compute_id
Aug 16 17:56:11 user nova-compute[72000]: WARNING nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Compute nodes ['41d2d9e5-ac93-4703-9b48-d29797f5aeb9'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 16 17:56:11 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 16 17:56:11 user nova-compute[72000]: WARNING nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 16 17:56:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:56:11 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:56:11 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:56:11 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Hypervisor/Node resource view: name=user free_ram=10832MB free_disk=24.610820770263672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:56:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:56:11 user nova-compute[72000]: WARNING nova.compute.resource_tracker [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] No compute node record for user:41d2d9e5-ac93-4703-9b48-d29797f5aeb9: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 could not be found.
Aug 16 17:56:12 user nova-compute[72000]: INFO nova.compute.resource_tracker [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Compute node record created for user:user with uuid: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:56:12 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [req-b9975020-56ec-4c11-a05b-f66bc07323eb] Created resource provider record via placement API for resource provider with UUID 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 and name user.
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72000) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 16 17:56:12 user nova-compute[72000]: INFO nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] kernel doesn't support AMD SEV
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Libvirt baseline CPU <cpu>
Aug 16 17:56:12 user nova-compute[72000]:   <arch>x86_64</arch>
Aug 16 17:56:12 user nova-compute[72000]:   <model>Nehalem</model>
Aug 16 17:56:12 user nova-compute[72000]:   <vendor>Intel</vendor>
Aug 16 17:56:12 user nova-compute[72000]:   <topology sockets="6" cores="1" threads="1"/>
Aug 16 17:56:12 user nova-compute[72000]: </cpu>
Aug 16 17:56:12 user nova-compute[72000]:  {{(pid=72000) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Updated inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Updating resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 generation from 0 to 1 during operation: update_inventory {{(pid=72000) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Updating resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 generation from 1 to 2 during operation: update_traits {{(pid=72000) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.875s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.service [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Creating RPC server for service compute {{(pid=72000) start /opt/stack/nova/nova/service.py:182}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.service [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Join ServiceGroup membership for this service compute {{(pid=72000) start /opt/stack/nova/nova/service.py:199}}
Aug 16 17:56:12 user nova-compute[72000]: DEBUG nova.servicegroup.drivers.db [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72000) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 16 17:56:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:56:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:57:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:57:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:57:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=10229MB free_disk=24.5145263671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:57:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:57:04 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:57:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:57:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:57:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:58:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:58:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=10168MB free_disk=24.560733795166016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:58:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:59:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:59:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 17:59:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 17:59:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 17:59:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:59:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:59:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 17:59:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:59:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:59:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 17:59:06 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:59:06 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 17:59:06 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=10204MB free_disk=24.344867706298828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 17:59:06 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 17:59:07 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 17:59:07 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 17:59:07 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 17:59:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:00:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:00:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:00:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:00:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:00:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:00:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:00:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 18:00:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:00:06 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:00:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:00:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:00:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:00:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:08 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:00:08 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:08 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:08 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=9403MB free_disk=24.367969512939453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:09 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:00:09 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:00:09 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:00:09 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:00:09 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:16 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:00:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:00:16 user nova-compute[72000]: INFO nova.compute.claims [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Claim successful on node user
Aug 16 18:00:17 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:00:17 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:00:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:00:17 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Creating image(s)
Aug 16 18:00:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "/opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "/opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56.part --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:18 user nova-compute[72000]: DEBUG nova.policy [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb9c67db30d3443eaf28670635863118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c4769a48b847f994e32e7c01bd39e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:00:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56.part --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:18 user nova-compute[72000]: DEBUG nova.virt.images [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] c19ae381-62a6-4e07-8c3a-fefacf5c24ea was qcow2, converting to raw {{(pid=72000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 18:00:18 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:00:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56.part /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56.converted {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56.part /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56.converted" returned: 0 in 0.324s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56.converted --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.327s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:19 user nova-compute[72000]: INFO oslo.privsep.daemon [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpx29m03tj/privsep.sock']
Aug 16 18:00:19 user sudo[81263]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpx29m03tj/privsep.sock
Aug 16 18:00:19 user sudo[81263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 18:00:20 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Successfully created port: 6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:00:21 user sudo[81263]: pam_unix(sudo:session): session closed for user root
Aug 16 18:00:21 user nova-compute[72000]: INFO oslo.privsep.daemon [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Spawned new privsep daemon via rootwrap
Aug 16 18:00:21 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 18:00:21 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 18:00:21 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 16 18:00:21 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81272
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.165s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.209s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk 1073741824" returned: 0 in 0.052s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:00:21 user nova-compute[72000]: INFO nova.compute.claims [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Claim successful on node user
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.207s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:00:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Cannot resize image /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'migration_context' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Ensure instance console log exists: /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.820s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.731s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:00:22 user nova-compute[72000]: INFO nova.compute.claims [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Claim successful on node user
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:00:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:00:22 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:00:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Creating image(s)
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "/opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "/opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "/opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.network.neutron [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:00:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.policy [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d6f2d34629946ba9884b356f1df71e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c736b21ec661426490744efe8f2a112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.211s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:00:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Creating image(s)
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "/opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "/opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk 1073741824" returned: 0 in 0.057s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.policy [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d24985b850c46e3bdb31296af169a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae4b7b47c8c9413d828928c6132eb104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.218s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:00:23 user nova-compute[72000]: INFO nova.compute.claims [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Claim successful on node user
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.203s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk 1073741824" returned: 0 in 0.052s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Cannot resize image /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lazy-loading 'migration_context' on Instance uuid 0654db58-a031-4998-bb1e-d4fa7f2a7046 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Ensure instance console log exists: /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.202s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:00:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.network.neutron [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Cannot resize image /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.objects.instance [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lazy-loading 'migration_context' on Instance uuid e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:24 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Ensure instance console log exists: /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:00:24 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Creating image(s)
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "/opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "/opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG nova.policy [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bb202933952474c99d17811058efc7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df523a13c0914e4ea7c2782d10e6535c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.221s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.222s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk 1073741824" returned: 0 in 0.050s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Successfully updated port: 6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Cannot resize image /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.objects.instance [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'migration_context' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Ensure instance console log exists: /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Successfully created port: fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-3ac4b00b-f282-41a7-ba04-e5658181a59a req-5a879142-554f-43f5-bc5d-78c2696feff9 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received event network-changed-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-3ac4b00b-f282-41a7-ba04-e5658181a59a req-5a879142-554f-43f5-bc5d-78c2696feff9 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Refreshing instance network info cache due to event network-changed-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:00:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3ac4b00b-f282-41a7-ba04-e5658181a59a req-5a879142-554f-43f5-bc5d-78c2696feff9 service nova] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:26 user nova-compute[72000]: DEBUG nova.network.neutron [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Successfully created port: 548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:00:26 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Instance network_info: |[{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3ac4b00b-f282-41a7-ba04-e5658181a59a req-5a879142-554f-43f5-bc5d-78c2696feff9 service nova] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.network.neutron [req-3ac4b00b-f282-41a7-ba04-e5658181a59a req-5a879142-554f-43f5-bc5d-78c2696feff9 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Refreshing network info cache for port 6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Start _get_guest_xml network_info=[{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Successfully created port: 6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:00:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2050389443',display_name='tempest-ServerActionsTestOtherA-server-2050389443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2050389443',id=1,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOboTwX+yPl3Cog939zVL+RXhe2iURuYdIg/tydSG7rmvgQL9izant50X7bWgjKoD0OObZiShgjaYDVLpgpQ938h9ReyNLR83Wx2HtCoNu1LYpjzQ+Y1Ln/EOXdF1uY+1g==',key_name='tempest-keypair-1361855606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-5b1orq5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=3ca4f9a6-2790-45d5-ba30-615398c045c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7a83f2-7b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:00:27 user nova-compute[72000]:   <uuid>3ca4f9a6-2790-45d5-ba30-615398c045c4</uuid>
Aug 16 18:00:27 user nova-compute[72000]:   <name>instance-00000001</name>
Aug 16 18:00:27 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:00:27 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:00:27 user nova-compute[72000]:   <metadata>
Aug 16 18:00:27 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:00:27 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:00:27 user nova-compute[72000]:       <nova:name>tempest-ServerActionsTestOtherA-server-2050389443</nova:name>
Aug 16 18:00:27 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:00:27</nova:creationTime>
Aug 16 18:00:27 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:00:27 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:00:27 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:00:27 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:00:27 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:00:27 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:00:27 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:00:27 user nova-compute[72000]:       <nova:owner>
Aug 16 18:00:27 user nova-compute[72000]:         <nova:user uuid="fb9c67db30d3443eaf28670635863118">tempest-ServerActionsTestOtherA-1630250690-project-member</nova:user>
Aug 16 18:00:27 user nova-compute[72000]:         <nova:project uuid="72c4769a48b847f994e32e7c01bd39e0">tempest-ServerActionsTestOtherA-1630250690</nova:project>
Aug 16 18:00:27 user nova-compute[72000]:       </nova:owner>
Aug 16 18:00:27 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:00:27 user nova-compute[72000]:       <nova:ports>
Aug 16 18:00:27 user nova-compute[72000]:         <nova:port uuid="6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f">
Aug 16 18:00:27 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 18:00:27 user nova-compute[72000]:         </nova:port>
Aug 16 18:00:27 user nova-compute[72000]:       </nova:ports>
Aug 16 18:00:27 user nova-compute[72000]:     </nova:instance>
Aug 16 18:00:27 user nova-compute[72000]:   </metadata>
Aug 16 18:00:27 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:00:27 user nova-compute[72000]:     <system>
Aug 16 18:00:27 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:00:27 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:00:27 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:00:27 user nova-compute[72000]:       <entry name="serial">3ca4f9a6-2790-45d5-ba30-615398c045c4</entry>
Aug 16 18:00:27 user nova-compute[72000]:       <entry name="uuid">3ca4f9a6-2790-45d5-ba30-615398c045c4</entry>
Aug 16 18:00:27 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:00:27 user nova-compute[72000]:     </system>
Aug 16 18:00:27 user nova-compute[72000]:   </sysinfo>
Aug 16 18:00:27 user nova-compute[72000]:   <os>
Aug 16 18:00:27 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:00:27 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:00:27 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:00:27 user nova-compute[72000]:   </os>
Aug 16 18:00:27 user nova-compute[72000]:   <features>
Aug 16 18:00:27 user nova-compute[72000]:     <acpi/>
Aug 16 18:00:27 user nova-compute[72000]:     <apic/>
Aug 16 18:00:27 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:00:27 user nova-compute[72000]:   </features>
Aug 16 18:00:27 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:00:27 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:00:27 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:00:27 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:00:27 user nova-compute[72000]:   </clock>
Aug 16 18:00:27 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:00:27 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:00:27 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:00:27 user nova-compute[72000]:   </cpu>
Aug 16 18:00:27 user nova-compute[72000]:   <devices>
Aug 16 18:00:27 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:00:27 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:00:27 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk"/>
Aug 16 18:00:27 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:00:27 user nova-compute[72000]:     </disk>
Aug 16 18:00:27 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:00:27 user nova-compute[72000]:       <mac address="fa:16:3e:9d:ae:f2"/>
Aug 16 18:00:27 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:27 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:00:27 user nova-compute[72000]:       <target dev="tap6b7a83f2-7b"/>
Aug 16 18:00:27 user nova-compute[72000]:     </interface>
Aug 16 18:00:27 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:00:27 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/console.log" append="off"/>
Aug 16 18:00:27 user nova-compute[72000]:     </serial>
Aug 16 18:00:27 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:00:27 user nova-compute[72000]:     <video>
Aug 16 18:00:27 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:27 user nova-compute[72000]:     </video>
Aug 16 18:00:27 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:00:27 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:00:27 user nova-compute[72000]:     </rng>
Aug 16 18:00:27 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:00:27 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:00:27 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:00:27 user nova-compute[72000]:     </memballoon>
Aug 16 18:00:27 user nova-compute[72000]:   </devices>
Aug 16 18:00:27 user nova-compute[72000]: </domain>
Aug 16 18:00:27 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2050389443',display_name='tempest-ServerActionsTestOtherA-server-2050389443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2050389443',id=1,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOboTwX+yPl3Cog939zVL+RXhe2iURuYdIg/tydSG7rmvgQL9izant50X7bWgjKoD0OObZiShgjaYDVLpgpQ938h9ReyNLR83Wx2HtCoNu1LYpjzQ+Y1Ln/EOXdF1uY+1g==',key_name='tempest-keypair-1361855606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-5b1orq5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=3ca4f9a6-2790-45d5-ba30-615398c045c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7a83f2-7b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG os_vif [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7a83f2-7b') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Created schema index Interface.name {{(pid=72000) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Created schema index Port.name {{(pid=72000) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Created schema index Bridge.name {{(pid=72000) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [POLLOUT] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:00:27 user nova-compute[72000]: INFO oslo.privsep.daemon [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp2vvpwofo/privsep.sock']
Aug 16 18:00:27 user sudo[81353]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp2vvpwofo/privsep.sock
Aug 16 18:00:27 user sudo[81353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 18:00:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Successfully updated port: 548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:00:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquired lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:00:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:00:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-1c90121a-f708-4100-a570-b87cfde7ecf2 req-e0f0be7a-743a-462c-9324-b44bbe1215c8 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-changed-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-1c90121a-f708-4100-a570-b87cfde7ecf2 req-e0f0be7a-743a-462c-9324-b44bbe1215c8 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Refreshing instance network info cache due to event network-changed-548341b0-47da-4962-b21a-fd4cc4118bdc. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:00:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1c90121a-f708-4100-a570-b87cfde7ecf2 req-e0f0be7a-743a-462c-9324-b44bbe1215c8 service nova] Acquiring lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Releasing lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance network_info: |[{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1c90121a-f708-4100-a570-b87cfde7ecf2 req-e0f0be7a-743a-462c-9324-b44bbe1215c8 service nova] Acquired lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-1c90121a-f708-4100-a570-b87cfde7ecf2 req-e0f0be7a-743a-462c-9324-b44bbe1215c8 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Refreshing network info cache for port 548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Start _get_guest_xml network_info=[{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:00:29 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:29 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-158489387',display_name='tempest-ServerActionsTestOtherB-server-158489387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-158489387',id=4,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrdiqOjF0w82oTGC6W8NyzHji/AAi+fARuYFDptSsxWEW2f7mWefGKfWyQtISbWHzqnq0YFbbPnDR8XKw6XPCJva4Yjg8+O3HxmlUuJZCmEJf2X0VZ0VVhtvx/qeQ8XoQ==',key_name='tempest-keypair-1407087314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df523a13c0914e4ea7c2782d10e6535c',ramdisk_id='',reservation_id='r-hdgm4kha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-915732487',owner_user_name='tempest-ServerActionsTestOtherB-915732487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb202933952474c99d17811058efc7c',uuid=a8532341-62b3-4c58-b3d8-db5440ad08c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converting VIF {"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.objects.instance [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'pci_devices' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:00:29 user nova-compute[72000]:   <uuid>a8532341-62b3-4c58-b3d8-db5440ad08c3</uuid>
Aug 16 18:00:29 user nova-compute[72000]:   <name>instance-00000004</name>
Aug 16 18:00:29 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:00:29 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:00:29 user nova-compute[72000]:   <metadata>
Aug 16 18:00:29 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:00:29 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:00:29 user nova-compute[72000]:       <nova:name>tempest-ServerActionsTestOtherB-server-158489387</nova:name>
Aug 16 18:00:29 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:00:29</nova:creationTime>
Aug 16 18:00:29 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:00:29 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:00:29 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:00:29 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:00:29 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:00:29 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:00:29 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:00:29 user nova-compute[72000]:       <nova:owner>
Aug 16 18:00:29 user nova-compute[72000]:         <nova:user uuid="4bb202933952474c99d17811058efc7c">tempest-ServerActionsTestOtherB-915732487-project-member</nova:user>
Aug 16 18:00:29 user nova-compute[72000]:         <nova:project uuid="df523a13c0914e4ea7c2782d10e6535c">tempest-ServerActionsTestOtherB-915732487</nova:project>
Aug 16 18:00:29 user nova-compute[72000]:       </nova:owner>
Aug 16 18:00:29 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:00:29 user nova-compute[72000]:       <nova:ports>
Aug 16 18:00:29 user nova-compute[72000]:         <nova:port uuid="548341b0-47da-4962-b21a-fd4cc4118bdc">
Aug 16 18:00:29 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 18:00:29 user nova-compute[72000]:         </nova:port>
Aug 16 18:00:29 user nova-compute[72000]:       </nova:ports>
Aug 16 18:00:29 user nova-compute[72000]:     </nova:instance>
Aug 16 18:00:29 user nova-compute[72000]:   </metadata>
Aug 16 18:00:29 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:00:29 user nova-compute[72000]:     <system>
Aug 16 18:00:29 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:00:29 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:00:29 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:00:29 user nova-compute[72000]:       <entry name="serial">a8532341-62b3-4c58-b3d8-db5440ad08c3</entry>
Aug 16 18:00:29 user nova-compute[72000]:       <entry name="uuid">a8532341-62b3-4c58-b3d8-db5440ad08c3</entry>
Aug 16 18:00:29 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:00:29 user nova-compute[72000]:     </system>
Aug 16 18:00:29 user nova-compute[72000]:   </sysinfo>
Aug 16 18:00:29 user nova-compute[72000]:   <os>
Aug 16 18:00:29 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:00:29 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:00:29 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:00:29 user nova-compute[72000]:   </os>
Aug 16 18:00:29 user nova-compute[72000]:   <features>
Aug 16 18:00:29 user nova-compute[72000]:     <acpi/>
Aug 16 18:00:29 user nova-compute[72000]:     <apic/>
Aug 16 18:00:29 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:00:29 user nova-compute[72000]:   </features>
Aug 16 18:00:29 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:00:29 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:00:29 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:00:29 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:00:29 user nova-compute[72000]:   </clock>
Aug 16 18:00:29 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:00:29 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:00:29 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:00:29 user nova-compute[72000]:   </cpu>
Aug 16 18:00:29 user nova-compute[72000]:   <devices>
Aug 16 18:00:29 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:00:29 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:00:29 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk"/>
Aug 16 18:00:29 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:00:29 user nova-compute[72000]:     </disk>
Aug 16 18:00:29 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:00:29 user nova-compute[72000]:       <mac address="fa:16:3e:98:69:d9"/>
Aug 16 18:00:29 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:29 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:00:29 user nova-compute[72000]:       <target dev="tap548341b0-47"/>
Aug 16 18:00:29 user nova-compute[72000]:     </interface>
Aug 16 18:00:29 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:00:29 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/console.log" append="off"/>
Aug 16 18:00:29 user nova-compute[72000]:     </serial>
Aug 16 18:00:29 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:00:29 user nova-compute[72000]:     <video>
Aug 16 18:00:29 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:29 user nova-compute[72000]:     </video>
Aug 16 18:00:29 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:00:29 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:00:29 user nova-compute[72000]:     </rng>
Aug 16 18:00:29 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:00:29 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:00:29 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:00:29 user nova-compute[72000]:     </memballoon>
Aug 16 18:00:29 user nova-compute[72000]:   </devices>
Aug 16 18:00:29 user nova-compute[72000]: </domain>
Aug 16 18:00:29 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-158489387',display_name='tempest-ServerActionsTestOtherB-server-158489387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-158489387',id=4,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrdiqOjF0w82oTGC6W8NyzHji/AAi+fARuYFDptSsxWEW2f7mWefGKfWyQtISbWHzqnq0YFbbPnDR8XKw6XPCJva4Yjg8+O3HxmlUuJZCmEJf2X0VZ0VVhtvx/qeQ8XoQ==',key_name='tempest-keypair-1407087314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df523a13c0914e4ea7c2782d10e6535c',ramdisk_id='',reservation_id='r-hdgm4kha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-915732487',owner_user_name='tempest-ServerActionsTestOtherB-915732487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb202933952474c99d17811058efc7c',uuid=a8532341-62b3-4c58-b3d8-db5440ad08c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converting VIF {"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG os_vif [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:00:29 user sudo[81353]: pam_unix(sudo:session): session closed for user root
Aug 16 18:00:29 user nova-compute[72000]: INFO oslo.privsep.daemon [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Spawned new privsep daemon via rootwrap
Aug 16 18:00:29 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 18:00:29 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 18:00:29 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 16 18:00:29 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81356
Aug 16 18:00:29 user nova-compute[72000]: WARNING oslo_privsep.priv_context [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] privsep daemon already running
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-3ac4b00b-f282-41a7-ba04-e5658181a59a req-5a879142-554f-43f5-bc5d-78c2696feff9 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated VIF entry in instance network info cache for port 6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-3ac4b00b-f282-41a7-ba04-e5658181a59a req-5a879142-554f-43f5-bc5d-78c2696feff9 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3ac4b00b-f282-41a7-ba04-e5658181a59a req-5a879142-554f-43f5-bc5d-78c2696feff9 service nova] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Successfully updated port: fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "refresh_cache-0654db58-a031-4998-bb1e-d4fa7f2a7046" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquired lock "refresh_cache-0654db58-a031-4998-bb1e-d4fa7f2a7046" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-f430736b-2c3a-490a-8e23-f0d5d4e64596 req-9598e8a4-4cb6-45c4-8d04-b777f8c4a21f service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Received event network-changed-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-f430736b-2c3a-490a-8e23-f0d5d4e64596 req-9598e8a4-4cb6-45c4-8d04-b777f8c4a21f service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Refreshing instance network info cache due to event network-changed-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f430736b-2c3a-490a-8e23-f0d5d4e64596 req-9598e8a4-4cb6-45c4-8d04-b777f8c4a21f service nova] Acquiring lock "refresh_cache-0654db58-a031-4998-bb1e-d4fa7f2a7046" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-1c90121a-f708-4100-a570-b87cfde7ecf2 req-e0f0be7a-743a-462c-9324-b44bbe1215c8 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updated VIF entry in instance network info cache for port 548341b0-47da-4962-b21a-fd4cc4118bdc. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-1c90121a-f708-4100-a570-b87cfde7ecf2 req-e0f0be7a-743a-462c-9324-b44bbe1215c8 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1c90121a-f708-4100-a570-b87cfde7ecf2 req-e0f0be7a-743a-462c-9324-b44bbe1215c8 service nova] Releasing lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap548341b0-47, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap548341b0-47, col_values=(('external_ids', {'iface-id': '548341b0-47da-4962-b21a-fd4cc4118bdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:69:d9', 'vm-uuid': 'a8532341-62b3-4c58-b3d8-db5440ad08c3'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:29 user nova-compute[72000]: INFO os_vif [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47')
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b7a83f2-7b, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b7a83f2-7b, col_values=(('external_ids', {'iface-id': '6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:ae:f2', 'vm-uuid': '3ca4f9a6-2790-45d5-ba30-615398c045c4'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] No VIF found with MAC fa:16:3e:98:69:d9, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:29 user nova-compute[72000]: INFO os_vif [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7a83f2-7b')
Aug 16 18:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:00:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No VIF found with MAC fa:16:3e:9d:ae:f2, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Updating instance_info_cache with network_info: [{"id": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "address": "fa:16:3e:c1:b9:f0", "network": {"id": "e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1659872504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c736b21ec661426490744efe8f2a112a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7a5d1a-9a", "ovs_interfaceid": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Releasing lock "refresh_cache-0654db58-a031-4998-bb1e-d4fa7f2a7046" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Instance network_info: |[{"id": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "address": "fa:16:3e:c1:b9:f0", "network": {"id": "e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1659872504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c736b21ec661426490744efe8f2a112a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7a5d1a-9a", "ovs_interfaceid": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f430736b-2c3a-490a-8e23-f0d5d4e64596 req-9598e8a4-4cb6-45c4-8d04-b777f8c4a21f service nova] Acquired lock "refresh_cache-0654db58-a031-4998-bb1e-d4fa7f2a7046" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.network.neutron [req-f430736b-2c3a-490a-8e23-f0d5d4e64596 req-9598e8a4-4cb6-45c4-8d04-b777f8c4a21f service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Refreshing network info cache for port fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Start _get_guest_xml network_info=[{"id": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "address": "fa:16:3e:c1:b9:f0", "network": {"id": "e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1659872504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c736b21ec661426490744efe8f2a112a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7a5d1a-9a", "ovs_interfaceid": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:00:30 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:30 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-926137146',display_name='tempest-DeleteServersTestJSON-server-926137146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-926137146',id=3,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c736b21ec661426490744efe8f2a112a',ramdisk_id='',reservation_id='r-qkweuiw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1434220361',owner_user_name='tempest-DeleteServersTestJSON-1434220361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:23Z,user_data=None,user_id='9d6f2d34629946ba9884b356f1df71e4',uuid=0654db58-a031-4998-bb1e-d4fa7f2a7046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "address": "fa:16:3e:c1:b9:f0", "network": {"id": "e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1659872504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c736b21ec661426490744efe8f2a112a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7a5d1a-9a", "ovs_interfaceid": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Converting VIF {"id": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "address": "fa:16:3e:c1:b9:f0", "network": {"id": "e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1659872504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c736b21ec661426490744efe8f2a112a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7a5d1a-9a", "ovs_interfaceid": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b9:f0,bridge_name='br-int',has_traffic_filtering=True,id=fa7a5d1a-9afa-47ba-9be7-34e44f229a1b,network=Network(e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7a5d1a-9a') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lazy-loading 'pci_devices' on Instance uuid 0654db58-a031-4998-bb1e-d4fa7f2a7046 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:00:30 user nova-compute[72000]:   <uuid>0654db58-a031-4998-bb1e-d4fa7f2a7046</uuid>
Aug 16 18:00:30 user nova-compute[72000]:   <name>instance-00000003</name>
Aug 16 18:00:30 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:00:30 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:00:30 user nova-compute[72000]:   <metadata>
Aug 16 18:00:30 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:00:30 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:00:30 user nova-compute[72000]:       <nova:name>tempest-DeleteServersTestJSON-server-926137146</nova:name>
Aug 16 18:00:30 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:00:30</nova:creationTime>
Aug 16 18:00:30 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:00:30 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:00:30 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:00:30 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:00:30 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:00:30 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:00:30 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:00:30 user nova-compute[72000]:       <nova:owner>
Aug 16 18:00:30 user nova-compute[72000]:         <nova:user uuid="9d6f2d34629946ba9884b356f1df71e4">tempest-DeleteServersTestJSON-1434220361-project-member</nova:user>
Aug 16 18:00:30 user nova-compute[72000]:         <nova:project uuid="c736b21ec661426490744efe8f2a112a">tempest-DeleteServersTestJSON-1434220361</nova:project>
Aug 16 18:00:30 user nova-compute[72000]:       </nova:owner>
Aug 16 18:00:30 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:00:30 user nova-compute[72000]:       <nova:ports>
Aug 16 18:00:30 user nova-compute[72000]:         <nova:port uuid="fa7a5d1a-9afa-47ba-9be7-34e44f229a1b">
Aug 16 18:00:30 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 18:00:30 user nova-compute[72000]:         </nova:port>
Aug 16 18:00:30 user nova-compute[72000]:       </nova:ports>
Aug 16 18:00:30 user nova-compute[72000]:     </nova:instance>
Aug 16 18:00:30 user nova-compute[72000]:   </metadata>
Aug 16 18:00:30 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:00:30 user nova-compute[72000]:     <system>
Aug 16 18:00:30 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:00:30 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:00:30 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:00:30 user nova-compute[72000]:       <entry name="serial">0654db58-a031-4998-bb1e-d4fa7f2a7046</entry>
Aug 16 18:00:30 user nova-compute[72000]:       <entry name="uuid">0654db58-a031-4998-bb1e-d4fa7f2a7046</entry>
Aug 16 18:00:30 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:00:30 user nova-compute[72000]:     </system>
Aug 16 18:00:30 user nova-compute[72000]:   </sysinfo>
Aug 16 18:00:30 user nova-compute[72000]:   <os>
Aug 16 18:00:30 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:00:30 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:00:30 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:00:30 user nova-compute[72000]:   </os>
Aug 16 18:00:30 user nova-compute[72000]:   <features>
Aug 16 18:00:30 user nova-compute[72000]:     <acpi/>
Aug 16 18:00:30 user nova-compute[72000]:     <apic/>
Aug 16 18:00:30 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:00:30 user nova-compute[72000]:   </features>
Aug 16 18:00:30 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:00:30 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:00:30 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:00:30 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:00:30 user nova-compute[72000]:   </clock>
Aug 16 18:00:30 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:00:30 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:00:30 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:00:30 user nova-compute[72000]:   </cpu>
Aug 16 18:00:30 user nova-compute[72000]:   <devices>
Aug 16 18:00:30 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:00:30 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:00:30 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk"/>
Aug 16 18:00:30 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:00:30 user nova-compute[72000]:     </disk>
Aug 16 18:00:30 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:00:30 user nova-compute[72000]:       <mac address="fa:16:3e:c1:b9:f0"/>
Aug 16 18:00:30 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:30 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:00:30 user nova-compute[72000]:       <target dev="tapfa7a5d1a-9a"/>
Aug 16 18:00:30 user nova-compute[72000]:     </interface>
Aug 16 18:00:30 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:00:30 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/console.log" append="off"/>
Aug 16 18:00:30 user nova-compute[72000]:     </serial>
Aug 16 18:00:30 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:00:30 user nova-compute[72000]:     <video>
Aug 16 18:00:30 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:30 user nova-compute[72000]:     </video>
Aug 16 18:00:30 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:00:30 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:00:30 user nova-compute[72000]:     </rng>
Aug 16 18:00:30 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:00:30 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:00:30 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:00:30 user nova-compute[72000]:     </memballoon>
Aug 16 18:00:30 user nova-compute[72000]:   </devices>
Aug 16 18:00:30 user nova-compute[72000]: </domain>
Aug 16 18:00:30 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-926137146',display_name='tempest-DeleteServersTestJSON-server-926137146',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-926137146',id=3,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c736b21ec661426490744efe8f2a112a',ramdisk_id='',reservation_id='r-qkweuiw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1434220361',owner_user_name='tempest-DeleteServersTestJSON-1434220361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:23Z,user_data=None,user_id='9d6f2d34629946ba9884b356f1df71e4',uuid=0654db58-a031-4998-bb1e-d4fa7f2a7046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "address": "fa:16:3e:c1:b9:f0", "network": {"id": "e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1659872504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c736b21ec661426490744efe8f2a112a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7a5d1a-9a", "ovs_interfaceid": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Converting VIF {"id": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "address": "fa:16:3e:c1:b9:f0", "network": {"id": "e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1659872504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c736b21ec661426490744efe8f2a112a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7a5d1a-9a", "ovs_interfaceid": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b9:f0,bridge_name='br-int',has_traffic_filtering=True,id=fa7a5d1a-9afa-47ba-9be7-34e44f229a1b,network=Network(e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7a5d1a-9a') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG os_vif [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b9:f0,bridge_name='br-int',has_traffic_filtering=True,id=fa7a5d1a-9afa-47ba-9be7-34e44f229a1b,network=Network(e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7a5d1a-9a') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa7a5d1a-9a, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa7a5d1a-9a, col_values=(('external_ids', {'iface-id': 'fa7a5d1a-9afa-47ba-9be7-34e44f229a1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:b9:f0', 'vm-uuid': '0654db58-a031-4998-bb1e-d4fa7f2a7046'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:00:30 user nova-compute[72000]: INFO nova.compute.claims [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Claim successful on node user
Aug 16 18:00:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:30 user nova-compute[72000]: INFO os_vif [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b9:f0,bridge_name='br-int',has_traffic_filtering=True,id=fa7a5d1a-9afa-47ba-9be7-34e44f229a1b,network=Network(e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7a5d1a-9a')
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:00:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] No VIF found with MAC fa:16:3e:c1:b9:f0, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:00:31 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Successfully updated port: 6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquired lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-077c94ad-0f04-4306-b494-26f6ea2a3e82 req-3de09546-ac3a-49e9-a68b-a647c60d41df service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Received event network-changed-6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-077c94ad-0f04-4306-b494-26f6ea2a3e82 req-3de09546-ac3a-49e9-a68b-a647c60d41df service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Refreshing instance network info cache due to event network-changed-6b7287a0-44f1-4148-83ce-e19342a7f4fd. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-077c94ad-0f04-4306-b494-26f6ea2a3e82 req-3de09546-ac3a-49e9-a68b-a647c60d41df service nova] Acquiring lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.policy [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6df288fb86024b8d8a10bb0d0049e499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcae1940950a4007898ba8d8ca6de402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:00:31 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Creating image(s)
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "/opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "/opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.network.neutron [req-f430736b-2c3a-490a-8e23-f0d5d4e64596 req-9598e8a4-4cb6-45c4-8d04-b777f8c4a21f service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Updated VIF entry in instance network info cache for port fa7a5d1a-9afa-47ba-9be7-34e44f229a1b. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG nova.network.neutron [req-f430736b-2c3a-490a-8e23-f0d5d4e64596 req-9598e8a4-4cb6-45c4-8d04-b777f8c4a21f service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Updating instance_info_cache with network_info: [{"id": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "address": "fa:16:3e:c1:b9:f0", "network": {"id": "e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1659872504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c736b21ec661426490744efe8f2a112a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7a5d1a-9a", "ovs_interfaceid": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f430736b-2c3a-490a-8e23-f0d5d4e64596 req-9598e8a4-4cb6-45c4-8d04-b777f8c4a21f service nova] Releasing lock "refresh_cache-0654db58-a031-4998-bb1e-d4fa7f2a7046" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.211s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.164s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk 1073741824" returned: 0 in 0.055s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Cannot resize image /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.objects.instance [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'migration_context' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Updating instance_info_cache with network_info: [{"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Ensure instance console log exists: /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Releasing lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Instance network_info: |[{"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-077c94ad-0f04-4306-b494-26f6ea2a3e82 req-3de09546-ac3a-49e9-a68b-a647c60d41df service nova] Acquired lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.network.neutron [req-077c94ad-0f04-4306-b494-26f6ea2a3e82 req-3de09546-ac3a-49e9-a68b-a647c60d41df service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Refreshing network info cache for port 6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Start _get_guest_xml network_info=[{"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:00:32 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:32 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-947053866',display_name='tempest-ServersNegativeTestJSON-server-947053866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-947053866',id=2,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae4b7b47c8c9413d828928c6132eb104',ramdisk_id='',reservation_id='r-ccxdnos9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-764876388',owner_user_name='tempest-ServersNegativeTestJSON-764876388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:23Z,user_data=None,user_id='7d24985b850c46e3bdb31296af169a23',uuid=e6d1db4c-f1e7-4019-80c6-a9703ab18dc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converting VIF {"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:58:3c,bridge_name='br-int',has_traffic_filtering=True,id=6b7287a0-44f1-4148-83ce-e19342a7f4fd,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7287a0-44') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.objects.instance [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lazy-loading 'pci_devices' on Instance uuid e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:00:32 user nova-compute[72000]:   <uuid>e6d1db4c-f1e7-4019-80c6-a9703ab18dc2</uuid>
Aug 16 18:00:32 user nova-compute[72000]:   <name>instance-00000002</name>
Aug 16 18:00:32 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:00:32 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:00:32 user nova-compute[72000]:   <metadata>
Aug 16 18:00:32 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:00:32 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:00:32 user nova-compute[72000]:       <nova:name>tempest-ServersNegativeTestJSON-server-947053866</nova:name>
Aug 16 18:00:32 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:00:32</nova:creationTime>
Aug 16 18:00:32 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:00:32 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:00:32 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:00:32 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:00:32 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:00:32 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:00:32 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:00:32 user nova-compute[72000]:       <nova:owner>
Aug 16 18:00:32 user nova-compute[72000]:         <nova:user uuid="7d24985b850c46e3bdb31296af169a23">tempest-ServersNegativeTestJSON-764876388-project-member</nova:user>
Aug 16 18:00:32 user nova-compute[72000]:         <nova:project uuid="ae4b7b47c8c9413d828928c6132eb104">tempest-ServersNegativeTestJSON-764876388</nova:project>
Aug 16 18:00:32 user nova-compute[72000]:       </nova:owner>
Aug 16 18:00:32 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:00:32 user nova-compute[72000]:       <nova:ports>
Aug 16 18:00:32 user nova-compute[72000]:         <nova:port uuid="6b7287a0-44f1-4148-83ce-e19342a7f4fd">
Aug 16 18:00:32 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 18:00:32 user nova-compute[72000]:         </nova:port>
Aug 16 18:00:32 user nova-compute[72000]:       </nova:ports>
Aug 16 18:00:32 user nova-compute[72000]:     </nova:instance>
Aug 16 18:00:32 user nova-compute[72000]:   </metadata>
Aug 16 18:00:32 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:00:32 user nova-compute[72000]:     <system>
Aug 16 18:00:32 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:00:32 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:00:32 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:00:32 user nova-compute[72000]:       <entry name="serial">e6d1db4c-f1e7-4019-80c6-a9703ab18dc2</entry>
Aug 16 18:00:32 user nova-compute[72000]:       <entry name="uuid">e6d1db4c-f1e7-4019-80c6-a9703ab18dc2</entry>
Aug 16 18:00:32 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:00:32 user nova-compute[72000]:     </system>
Aug 16 18:00:32 user nova-compute[72000]:   </sysinfo>
Aug 16 18:00:32 user nova-compute[72000]:   <os>
Aug 16 18:00:32 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:00:32 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:00:32 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:00:32 user nova-compute[72000]:   </os>
Aug 16 18:00:32 user nova-compute[72000]:   <features>
Aug 16 18:00:32 user nova-compute[72000]:     <acpi/>
Aug 16 18:00:32 user nova-compute[72000]:     <apic/>
Aug 16 18:00:32 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:00:32 user nova-compute[72000]:   </features>
Aug 16 18:00:32 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:00:32 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:00:32 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:00:32 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:00:32 user nova-compute[72000]:   </clock>
Aug 16 18:00:32 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:00:32 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:00:32 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:00:32 user nova-compute[72000]:   </cpu>
Aug 16 18:00:32 user nova-compute[72000]:   <devices>
Aug 16 18:00:32 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:00:32 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:00:32 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk"/>
Aug 16 18:00:32 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:00:32 user nova-compute[72000]:     </disk>
Aug 16 18:00:32 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:00:32 user nova-compute[72000]:       <mac address="fa:16:3e:17:58:3c"/>
Aug 16 18:00:32 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:32 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:00:32 user nova-compute[72000]:       <target dev="tap6b7287a0-44"/>
Aug 16 18:00:32 user nova-compute[72000]:     </interface>
Aug 16 18:00:32 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:00:32 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/console.log" append="off"/>
Aug 16 18:00:32 user nova-compute[72000]:     </serial>
Aug 16 18:00:32 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:00:32 user nova-compute[72000]:     <video>
Aug 16 18:00:32 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:32 user nova-compute[72000]:     </video>
Aug 16 18:00:32 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:00:32 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:00:32 user nova-compute[72000]:     </rng>
Aug 16 18:00:32 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:00:32 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:00:32 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:00:32 user nova-compute[72000]:     </memballoon>
Aug 16 18:00:32 user nova-compute[72000]:   </devices>
Aug 16 18:00:32 user nova-compute[72000]: </domain>
Aug 16 18:00:32 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-947053866',display_name='tempest-ServersNegativeTestJSON-server-947053866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-947053866',id=2,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae4b7b47c8c9413d828928c6132eb104',ramdisk_id='',reservation_id='r-ccxdnos9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-764876388',owner_user_name='tempest-ServersNegativeTestJSON-764876388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:23Z,user_data=None,user_id='7d24985b850c46e3bdb31296af169a23',uuid=e6d1db4c-f1e7-4019-80c6-a9703ab18dc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converting VIF {"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:58:3c,bridge_name='br-int',has_traffic_filtering=True,id=6b7287a0-44f1-4148-83ce-e19342a7f4fd,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7287a0-44') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG os_vif [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:58:3c,bridge_name='br-int',has_traffic_filtering=True,id=6b7287a0-44f1-4148-83ce-e19342a7f4fd,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7287a0-44') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b7287a0-44, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b7287a0-44, col_values=(('external_ids', {'iface-id': '6b7287a0-44f1-4148-83ce-e19342a7f4fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:58:3c', 'vm-uuid': 'e6d1db4c-f1e7-4019-80c6-a9703ab18dc2'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:32 user nova-compute[72000]: INFO os_vif [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:58:3c,bridge_name='br-int',has_traffic_filtering=True,id=6b7287a0-44f1-4148-83ce-e19342a7f4fd,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7287a0-44')
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] No VIF found with MAC fa:16:3e:17:58:3c, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Successfully created port: 2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:00:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:33 user nova-compute[72000]: DEBUG nova.network.neutron [req-077c94ad-0f04-4306-b494-26f6ea2a3e82 req-3de09546-ac3a-49e9-a68b-a647c60d41df service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Updated VIF entry in instance network info cache for port 6b7287a0-44f1-4148-83ce-e19342a7f4fd. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:00:33 user nova-compute[72000]: DEBUG nova.network.neutron [req-077c94ad-0f04-4306-b494-26f6ea2a3e82 req-3de09546-ac3a-49e9-a68b-a647c60d41df service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Updating instance_info_cache with network_info: [{"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-077c94ad-0f04-4306-b494-26f6ea2a3e82 req-3de09546-ac3a-49e9-a68b-a647c60d41df service nova] Releasing lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Successfully updated port: 2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:00:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquired lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:00:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-2db8d39e-bdb6-471d-ac22-9b2e7a1e0940 req-7bbb7e22-ba01-46c5-bd24-6b16eb855ace service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-changed-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-2db8d39e-bdb6-471d-ac22-9b2e7a1e0940 req-7bbb7e22-ba01-46c5-bd24-6b16eb855ace service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Refreshing instance network info cache due to event network-changed-2ac3c99f-65bd-4aaa-899d-41ec43d44906. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2db8d39e-bdb6-471d-ac22-9b2e7a1e0940 req-7bbb7e22-ba01-46c5-bd24-6b16eb855ace service nova] Acquiring lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updating instance_info_cache with network_info: [{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Releasing lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance network_info: |[{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2db8d39e-bdb6-471d-ac22-9b2e7a1e0940 req-7bbb7e22-ba01-46c5-bd24-6b16eb855ace service nova] Acquired lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-2db8d39e-bdb6-471d-ac22-9b2e7a1e0940 req-7bbb7e22-ba01-46c5-bd24-6b16eb855ace service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Refreshing network info cache for port 2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Start _get_guest_xml network_info=[{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:00:36 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:36 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1089625936',display_name='tempest-AttachVolumeTestJSON-server-1089625936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1089625936',id=5,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErb04qZpbsRut/09YXjqZYrtOHdBhP2tPvZwbKrovgBjHoU1dEbeqloQimLOszuW/qVazGtyEHJi8FlrHeWujg55/6v8atkLH5KmnvoByesgAKN67qz3UpqxjWpyoKkRQ==',key_name='tempest-keypair-622025030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-gr5a7kt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.objects.instance [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:00:36 user nova-compute[72000]:   <uuid>f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c</uuid>
Aug 16 18:00:36 user nova-compute[72000]:   <name>instance-00000005</name>
Aug 16 18:00:36 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:00:36 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:00:36 user nova-compute[72000]:   <metadata>
Aug 16 18:00:36 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:00:36 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:00:36 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeTestJSON-server-1089625936</nova:name>
Aug 16 18:00:36 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:00:36</nova:creationTime>
Aug 16 18:00:36 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:00:36 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:00:36 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:00:36 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:00:36 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:00:36 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:00:36 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:00:36 user nova-compute[72000]:       <nova:owner>
Aug 16 18:00:36 user nova-compute[72000]:         <nova:user uuid="6df288fb86024b8d8a10bb0d0049e499">tempest-AttachVolumeTestJSON-120427729-project-member</nova:user>
Aug 16 18:00:36 user nova-compute[72000]:         <nova:project uuid="fcae1940950a4007898ba8d8ca6de402">tempest-AttachVolumeTestJSON-120427729</nova:project>
Aug 16 18:00:36 user nova-compute[72000]:       </nova:owner>
Aug 16 18:00:36 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:00:36 user nova-compute[72000]:       <nova:ports>
Aug 16 18:00:36 user nova-compute[72000]:         <nova:port uuid="2ac3c99f-65bd-4aaa-899d-41ec43d44906">
Aug 16 18:00:36 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 18:00:36 user nova-compute[72000]:         </nova:port>
Aug 16 18:00:36 user nova-compute[72000]:       </nova:ports>
Aug 16 18:00:36 user nova-compute[72000]:     </nova:instance>
Aug 16 18:00:36 user nova-compute[72000]:   </metadata>
Aug 16 18:00:36 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:00:36 user nova-compute[72000]:     <system>
Aug 16 18:00:36 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:00:36 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:00:36 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:00:36 user nova-compute[72000]:       <entry name="serial">f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c</entry>
Aug 16 18:00:36 user nova-compute[72000]:       <entry name="uuid">f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c</entry>
Aug 16 18:00:36 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:00:36 user nova-compute[72000]:     </system>
Aug 16 18:00:36 user nova-compute[72000]:   </sysinfo>
Aug 16 18:00:36 user nova-compute[72000]:   <os>
Aug 16 18:00:36 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:00:36 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:00:36 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:00:36 user nova-compute[72000]:   </os>
Aug 16 18:00:36 user nova-compute[72000]:   <features>
Aug 16 18:00:36 user nova-compute[72000]:     <acpi/>
Aug 16 18:00:36 user nova-compute[72000]:     <apic/>
Aug 16 18:00:36 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:00:36 user nova-compute[72000]:   </features>
Aug 16 18:00:36 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:00:36 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:00:36 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:00:36 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:00:36 user nova-compute[72000]:   </clock>
Aug 16 18:00:36 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:00:36 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:00:36 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:00:36 user nova-compute[72000]:   </cpu>
Aug 16 18:00:36 user nova-compute[72000]:   <devices>
Aug 16 18:00:36 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:00:36 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:00:36 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk"/>
Aug 16 18:00:36 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:00:36 user nova-compute[72000]:     </disk>
Aug 16 18:00:36 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:00:36 user nova-compute[72000]:       <mac address="fa:16:3e:e1:0f:ec"/>
Aug 16 18:00:36 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:36 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:00:36 user nova-compute[72000]:       <target dev="tap2ac3c99f-65"/>
Aug 16 18:00:36 user nova-compute[72000]:     </interface>
Aug 16 18:00:36 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:00:36 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/console.log" append="off"/>
Aug 16 18:00:36 user nova-compute[72000]:     </serial>
Aug 16 18:00:36 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:00:36 user nova-compute[72000]:     <video>
Aug 16 18:00:36 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:36 user nova-compute[72000]:     </video>
Aug 16 18:00:36 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:00:36 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:00:36 user nova-compute[72000]:     </rng>
Aug 16 18:00:36 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:00:36 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:00:36 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:00:36 user nova-compute[72000]:     </memballoon>
Aug 16 18:00:36 user nova-compute[72000]:   </devices>
Aug 16 18:00:36 user nova-compute[72000]: </domain>
Aug 16 18:00:36 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1089625936',display_name='tempest-AttachVolumeTestJSON-server-1089625936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1089625936',id=5,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErb04qZpbsRut/09YXjqZYrtOHdBhP2tPvZwbKrovgBjHoU1dEbeqloQimLOszuW/qVazGtyEHJi8FlrHeWujg55/6v8atkLH5KmnvoByesgAKN67qz3UpqxjWpyoKkRQ==',key_name='tempest-keypair-622025030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-gr5a7kt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG os_vif [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ac3c99f-65, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ac3c99f-65, col_values=(('external_ids', {'iface-id': '2ac3c99f-65bd-4aaa-899d-41ec43d44906', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:0f:ec', 'vm-uuid': 'f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:36 user nova-compute[72000]: INFO os_vif [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65')
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No VIF found with MAC fa:16:3e:e1:0f:ec, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-2db8d39e-bdb6-471d-ac22-9b2e7a1e0940 req-7bbb7e22-ba01-46c5-bd24-6b16eb855ace service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updated VIF entry in instance network info cache for port 2ac3c99f-65bd-4aaa-899d-41ec43d44906. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-2db8d39e-bdb6-471d-ac22-9b2e7a1e0940 req-7bbb7e22-ba01-46c5-bd24-6b16eb855ace service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updating instance_info_cache with network_info: [{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2db8d39e-bdb6-471d-ac22-9b2e7a1e0940 req-7bbb7e22-ba01-46c5-bd24-6b16eb855ace service nova] Releasing lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:38 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208838.9926372, a8532341-62b3-4c58-b3d8-db5440ad08c3 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:00:38 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] VM Resumed (Lifecycle Event)
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:00:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance spawned successfully.
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:00:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208838.9997241, a8532341-62b3-4c58-b3d8-db5440ad08c3 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:00:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] VM Started (Lifecycle Event)
Aug 16 18:00:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:39 user nova-compute[72000]: INFO nova.compute.manager [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Took 14.88 seconds to spawn the instance on the hypervisor.
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:00:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:00:39 user nova-compute[72000]: INFO nova.compute.manager [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Took 15.97 seconds to build instance.
Aug 16 18:00:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-003b407d-0253-4b88-a36e-dfff8717d5d0 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.113s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208840.1299279, e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] VM Resumed (Lifecycle Event)
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Instance spawned successfully.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Instance spawned successfully.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Instance spawned successfully.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208840.1313772, e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] VM Started (Lifecycle Event)
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208840.1473894, 0654db58-a031-4998-bb1e-d4fa7f2a7046 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] VM Resumed (Lifecycle Event)
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Took 17.26 seconds to spawn the instance on the hypervisor.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Took 17.57 seconds to spawn the instance on the hypervisor.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208840.1556206, 0654db58-a031-4998-bb1e-d4fa7f2a7046 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] VM Started (Lifecycle Event)
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Took 22.90 seconds to spawn the instance on the hypervisor.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208840.2711554, 3ca4f9a6-2790-45d5-ba30-615398c045c4 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] VM Resumed (Lifecycle Event)
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Took 19.04 seconds to build instance.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6b6f70c-fceb-4aa1-8fcd-56c6d6d823d2 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.199s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Took 19.05 seconds to build instance.
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208840.2730412, 3ca4f9a6-2790-45d5-ba30-615398c045c4 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:00:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] VM Started (Lifecycle Event)
Aug 16 18:00:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-aec4626d-6f0c-4f4b-819b-86ff3e108df8 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.254s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:41 user nova-compute[72000]: INFO nova.compute.manager [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Took 24.25 seconds to build instance.
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3051716b-5a4f-447b-bc54-5ca5ffca146d tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.526s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208841.4645803, f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:00:41 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] VM Resumed (Lifecycle Event)
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:00:41 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance spawned successfully.
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:00:41 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208841.465016, f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:00:41 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] VM Started (Lifecycle Event)
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:00:41 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:00:41 user nova-compute[72000]: INFO nova.compute.manager [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Took 10.34 seconds to spawn the instance on the hypervisor.
Aug 16 18:00:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:00:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:41 user nova-compute[72000]: INFO nova.compute.manager [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Took 11.14 seconds to build instance.
Aug 16 18:00:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8a8316a6-e3ec-443f-b480-18ec2d095194 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.314s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Acquiring lock "49796cab-9592-4761-8acd-f54c1219ffb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "49796cab-9592-4761-8acd-f54c1219ffb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:00:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:00:44 user nova-compute[72000]: INFO nova.compute.claims [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Claim successful on node user
Aug 16 18:00:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:45 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:00:45 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:00:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.042s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:00:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:00:45 user nova-compute[72000]: DEBUG nova.network.neutron [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:00:45 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:00:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG nova.policy [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d450b2d680c4c018f87695f7eca039d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e666887ff3436ab1e0b019f9d7b888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:00:46 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Creating image(s)
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Acquiring lock "/opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "/opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "/opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.280s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.346s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk 1073741824" returned: 0 in 0.078s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.431s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.267s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Cannot resize image /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG nova.objects.instance [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lazy-loading 'migration_context' on Instance uuid 49796cab-9592-4761-8acd-f54c1219ffb9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Ensure instance console log exists: /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:48 user nova-compute[72000]: DEBUG nova.network.neutron [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Successfully created port: 05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:00:48 user nova-compute[72000]: DEBUG nova.compute.manager [req-852cc457-9073-4a07-b143-fc513b2d1eb6 req-d0ded302-6f51-436f-843b-2bcb2772adc0 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-852cc457-9073-4a07-b143-fc513b2d1eb6 req-d0ded302-6f51-436f-843b-2bcb2772adc0 service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-852cc457-9073-4a07-b143-fc513b2d1eb6 req-d0ded302-6f51-436f-843b-2bcb2772adc0 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-852cc457-9073-4a07-b143-fc513b2d1eb6 req-d0ded302-6f51-436f-843b-2bcb2772adc0 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:48 user nova-compute[72000]: DEBUG nova.compute.manager [req-852cc457-9073-4a07-b143-fc513b2d1eb6 req-d0ded302-6f51-436f-843b-2bcb2772adc0 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:00:48 user nova-compute[72000]: WARNING nova.compute.manager [req-852cc457-9073-4a07-b143-fc513b2d1eb6 req-d0ded302-6f51-436f-843b-2bcb2772adc0 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state active and task_state None.
Aug 16 18:00:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:00:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:00:49 user nova-compute[72000]: INFO nova.compute.claims [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Claim successful on node user
Aug 16 18:00:49 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:00:49 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:00:50 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.policy [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '090a1c872b734d0bb3daede325eca0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad509a974084c17ac6ffac36ca72c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:00:50 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Creating image(s)
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "/opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "/opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.294s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Successfully updated port: 05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:00:50 user nova-compute[72000]: WARNING nova.compute.manager [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state active and task_state None.
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received event network-vif-plugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] Acquiring lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] No waiting events found dispatching network-vif-plugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:00:50 user nova-compute[72000]: WARNING nova.compute.manager [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received unexpected event network-vif-plugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f for instance with vm_state active and task_state None.
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received event network-changed-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Refreshing instance network info cache due to event network-changed-05d4fd2c-6f16-49b4-9ed2-b9451611d094. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] Acquiring lock "refresh_cache-49796cab-9592-4761-8acd-f54c1219ffb9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] Acquired lock "refresh_cache-49796cab-9592-4761-8acd-f54c1219ffb9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG nova.network.neutron [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Refreshing network info cache for port 05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:00:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Acquiring lock "refresh_cache-49796cab-9592-4761-8acd-f54c1219ffb9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.271s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk 1073741824" returned: 0 in 0.068s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG nova.network.neutron [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.203s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Cannot resize image /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG nova.objects.instance [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lazy-loading 'migration_context' on Instance uuid b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Ensure instance console log exists: /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Successfully created port: 1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-218377b6-7dab-46e6-847b-6f614f56bb88 req-617cbbb3-9125-4ee3-9d1a-660aacd01805 service nova] Releasing lock "refresh_cache-49796cab-9592-4761-8acd-f54c1219ffb9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Acquired lock "refresh_cache-49796cab-9592-4761-8acd-f54c1219ffb9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG nova.network.neutron [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG nova.network.neutron [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Successfully updated port: 1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "0e7d8582-d732-4344-9f10-97ef34e8a391" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquired lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-0668f24b-1553-4a73-8ae0-70463dba6eff req-9dbd45af-536a-40fd-a067-4501179a1e97 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-changed-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-0668f24b-1553-4a73-8ae0-70463dba6eff req-9dbd45af-536a-40fd-a067-4501179a1e97 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Refreshing instance network info cache due to event network-changed-1bbf38dc-2654-4e85-9dd9-000af10e5c3f. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:00:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0668f24b-1553-4a73-8ae0-70463dba6eff req-9dbd45af-536a-40fd-a067-4501179a1e97 service nova] Acquiring lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received event network-vif-plugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] Acquiring lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] No waiting events found dispatching network-vif-plugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:00:53 user nova-compute[72000]: WARNING nova.compute.manager [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received unexpected event network-vif-plugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f for instance with vm_state active and task_state None.
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Received event network-vif-plugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] Acquiring lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] No waiting events found dispatching network-vif-plugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:00:53 user nova-compute[72000]: WARNING nova.compute.manager [req-cbd10f80-c567-4734-b5d4-e2ee20b006c0 req-9496e52c-f50d-4e63-8608-fe3867489ea8 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Received unexpected event network-vif-plugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b for instance with vm_state active and task_state None.
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:00:53 user nova-compute[72000]: INFO nova.compute.claims [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Claim successful on node user
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Updating instance_info_cache with network_info: [{"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Releasing lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Instance network_info: |[{"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0668f24b-1553-4a73-8ae0-70463dba6eff req-9dbd45af-536a-40fd-a067-4501179a1e97 service nova] Acquired lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.network.neutron [req-0668f24b-1553-4a73-8ae0-70463dba6eff req-9dbd45af-536a-40fd-a067-4501179a1e97 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Refreshing network info cache for port 1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Start _get_guest_xml network_info=[{"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:00:53 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:53 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-980540578',display_name='tempest-VolumesAdminNegativeTest-server-980540578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-980540578',id=7,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA/hvzt2Xh/5vjNJ5rw9TTlIFEn6CMi/PeB5dBzOMRW8SF/ewmX6eNapygm9Hj/JkkCcwxJvmctOR5ho+vVE3Ip69YZ775WexSUdrvPfd1NtVZAj+zCpKFCCehCxduAtg==',key_name='tempest-keypair-1302893124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad509a974084c17ac6ffac36ca72c50',ramdisk_id='',reservation_id='r-pv0rfu3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-127684415',owner_user_name='tempest-VolumesAdminNegativeTest-127684415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='090a1c872b734d0bb3daede325eca0df',uuid=b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converting VIF {"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=1bbf38dc-2654-4e85-9dd9-000af10e5c3f,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bbf38dc-26') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lazy-loading 'pci_devices' on Instance uuid b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:00:53 user nova-compute[72000]:   <uuid>b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212</uuid>
Aug 16 18:00:53 user nova-compute[72000]:   <name>instance-00000007</name>
Aug 16 18:00:53 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:00:53 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:00:53 user nova-compute[72000]:   <metadata>
Aug 16 18:00:53 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:00:53 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:00:53 user nova-compute[72000]:       <nova:name>tempest-VolumesAdminNegativeTest-server-980540578</nova:name>
Aug 16 18:00:53 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:00:53</nova:creationTime>
Aug 16 18:00:53 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:00:53 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:00:53 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:00:53 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:00:53 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:00:53 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:00:53 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:00:53 user nova-compute[72000]:       <nova:owner>
Aug 16 18:00:53 user nova-compute[72000]:         <nova:user uuid="090a1c872b734d0bb3daede325eca0df">tempest-VolumesAdminNegativeTest-127684415-project-member</nova:user>
Aug 16 18:00:53 user nova-compute[72000]:         <nova:project uuid="0ad509a974084c17ac6ffac36ca72c50">tempest-VolumesAdminNegativeTest-127684415</nova:project>
Aug 16 18:00:53 user nova-compute[72000]:       </nova:owner>
Aug 16 18:00:53 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:00:53 user nova-compute[72000]:       <nova:ports>
Aug 16 18:00:53 user nova-compute[72000]:         <nova:port uuid="1bbf38dc-2654-4e85-9dd9-000af10e5c3f">
Aug 16 18:00:53 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 18:00:53 user nova-compute[72000]:         </nova:port>
Aug 16 18:00:53 user nova-compute[72000]:       </nova:ports>
Aug 16 18:00:53 user nova-compute[72000]:     </nova:instance>
Aug 16 18:00:53 user nova-compute[72000]:   </metadata>
Aug 16 18:00:53 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:00:53 user nova-compute[72000]:     <system>
Aug 16 18:00:53 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:00:53 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:00:53 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:00:53 user nova-compute[72000]:       <entry name="serial">b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212</entry>
Aug 16 18:00:53 user nova-compute[72000]:       <entry name="uuid">b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212</entry>
Aug 16 18:00:53 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:00:53 user nova-compute[72000]:     </system>
Aug 16 18:00:53 user nova-compute[72000]:   </sysinfo>
Aug 16 18:00:53 user nova-compute[72000]:   <os>
Aug 16 18:00:53 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:00:53 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:00:53 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:00:53 user nova-compute[72000]:   </os>
Aug 16 18:00:53 user nova-compute[72000]:   <features>
Aug 16 18:00:53 user nova-compute[72000]:     <acpi/>
Aug 16 18:00:53 user nova-compute[72000]:     <apic/>
Aug 16 18:00:53 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:00:53 user nova-compute[72000]:   </features>
Aug 16 18:00:53 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:00:53 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:00:53 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:00:53 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:00:53 user nova-compute[72000]:   </clock>
Aug 16 18:00:53 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:00:53 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:00:53 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:00:53 user nova-compute[72000]:   </cpu>
Aug 16 18:00:53 user nova-compute[72000]:   <devices>
Aug 16 18:00:53 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:00:53 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:00:53 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk"/>
Aug 16 18:00:53 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:00:53 user nova-compute[72000]:     </disk>
Aug 16 18:00:53 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:00:53 user nova-compute[72000]:       <mac address="fa:16:3e:70:dd:99"/>
Aug 16 18:00:53 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:53 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:00:53 user nova-compute[72000]:       <target dev="tap1bbf38dc-26"/>
Aug 16 18:00:53 user nova-compute[72000]:     </interface>
Aug 16 18:00:53 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:00:53 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/console.log" append="off"/>
Aug 16 18:00:53 user nova-compute[72000]:     </serial>
Aug 16 18:00:53 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:00:53 user nova-compute[72000]:     <video>
Aug 16 18:00:53 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:53 user nova-compute[72000]:     </video>
Aug 16 18:00:53 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:00:53 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:00:53 user nova-compute[72000]:     </rng>
Aug 16 18:00:53 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:00:53 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:00:53 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:00:53 user nova-compute[72000]:     </memballoon>
Aug 16 18:00:53 user nova-compute[72000]:   </devices>
Aug 16 18:00:53 user nova-compute[72000]: </domain>
Aug 16 18:00:53 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-980540578',display_name='tempest-VolumesAdminNegativeTest-server-980540578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-980540578',id=7,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA/hvzt2Xh/5vjNJ5rw9TTlIFEn6CMi/PeB5dBzOMRW8SF/ewmX6eNapygm9Hj/JkkCcwxJvmctOR5ho+vVE3Ip69YZ775WexSUdrvPfd1NtVZAj+zCpKFCCehCxduAtg==',key_name='tempest-keypair-1302893124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad509a974084c17ac6ffac36ca72c50',ramdisk_id='',reservation_id='r-pv0rfu3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-127684415',owner_user_name='tempest-VolumesAdminNegativeTest-127684415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='090a1c872b734d0bb3daede325eca0df',uuid=b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converting VIF {"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=1bbf38dc-2654-4e85-9dd9-000af10e5c3f,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bbf38dc-26') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG os_vif [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=1bbf38dc-2654-4e85-9dd9-000af10e5c3f,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bbf38dc-26') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.network.neutron [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Updating instance_info_cache with network_info: [{"id": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "address": "fa:16:3e:2e:2a:35", "network": {"id": "9a48b52d-ed41-41d0-a5f9-4a51a64b73ac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1097559854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e666887ff3436ab1e0b019f9d7b888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d4fd2c-6f", "ovs_interfaceid": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Releasing lock "refresh_cache-49796cab-9592-4761-8acd-f54c1219ffb9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:53 user nova-compute[72000]: DEBUG nova.compute.manager [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Instance network_info: |[{"id": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "address": "fa:16:3e:2e:2a:35", "network": {"id": "9a48b52d-ed41-41d0-a5f9-4a51a64b73ac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1097559854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e666887ff3436ab1e0b019f9d7b888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d4fd2c-6f", "ovs_interfaceid": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Start _get_guest_xml network_info=[{"id": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "address": "fa:16:3e:2e:2a:35", "network": {"id": "9a48b52d-ed41-41d0-a5f9-4a51a64b73ac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1097559854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e666887ff3436ab1e0b019f9d7b888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d4fd2c-6f", "ovs_interfaceid": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bbf38dc-26, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1bbf38dc-26, col_values=(('external_ids', {'iface-id': '1bbf38dc-2654-4e85-9dd9-000af10e5c3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:dd:99', 'vm-uuid': 'b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:54 user nova-compute[72000]: INFO os_vif [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=1bbf38dc-2654-4e85-9dd9-000af10e5c3f,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bbf38dc-26')
Aug 16 18:00:54 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:54 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1572808618',display_name='tempest-VolumesAssistedSnapshotsTest-server-1572808618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1572808618',id=6,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8wmqoDL/hggERLBRduVW0o5Zj79xnzT2HL10/2sfWMRuXePHzkuGckupNM0bWdy5Cv1XIIblxGnl0yRhvzdaq7+GddOFQT427VOD2mXcF08Y4Vk26veXGAXoCFANdbsQ==',key_name='tempest-keypair-1415915389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e666887ff3436ab1e0b019f9d7b888',ramdisk_id='',reservation_id='r-b7epkmpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1424008607',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1424008607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d450b2d680c4c018f87695f7eca039d',uuid=49796cab-9592-4761-8acd-f54c1219ffb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "address": "fa:16:3e:2e:2a:35", "network": {"id": "9a48b52d-ed41-41d0-a5f9-4a51a64b73ac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1097559854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e666887ff3436ab1e0b019f9d7b888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d4fd2c-6f", "ovs_interfaceid": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Converting VIF {"id": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "address": "fa:16:3e:2e:2a:35", "network": {"id": "9a48b52d-ed41-41d0-a5f9-4a51a64b73ac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1097559854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e666887ff3436ab1e0b019f9d7b888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d4fd2c-6f", "ovs_interfaceid": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:35,bridge_name='br-int',has_traffic_filtering=True,id=05d4fd2c-6f16-49b4-9ed2-b9451611d094,network=Network(9a48b52d-ed41-41d0-a5f9-4a51a64b73ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d4fd2c-6f') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lazy-loading 'pci_devices' on Instance uuid 49796cab-9592-4761-8acd-f54c1219ffb9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:00:54 user nova-compute[72000]:   <uuid>49796cab-9592-4761-8acd-f54c1219ffb9</uuid>
Aug 16 18:00:54 user nova-compute[72000]:   <name>instance-00000006</name>
Aug 16 18:00:54 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:00:54 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:00:54 user nova-compute[72000]:   <metadata>
Aug 16 18:00:54 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:00:54 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:00:54 user nova-compute[72000]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1572808618</nova:name>
Aug 16 18:00:54 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:00:54</nova:creationTime>
Aug 16 18:00:54 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:00:54 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:00:54 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:00:54 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:00:54 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:00:54 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:00:54 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:00:54 user nova-compute[72000]:       <nova:owner>
Aug 16 18:00:54 user nova-compute[72000]:         <nova:user uuid="8d450b2d680c4c018f87695f7eca039d">tempest-VolumesAssistedSnapshotsTest-1424008607-project-member</nova:user>
Aug 16 18:00:54 user nova-compute[72000]:         <nova:project uuid="92e666887ff3436ab1e0b019f9d7b888">tempest-VolumesAssistedSnapshotsTest-1424008607</nova:project>
Aug 16 18:00:54 user nova-compute[72000]:       </nova:owner>
Aug 16 18:00:54 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:00:54 user nova-compute[72000]:       <nova:ports>
Aug 16 18:00:54 user nova-compute[72000]:         <nova:port uuid="05d4fd2c-6f16-49b4-9ed2-b9451611d094">
Aug 16 18:00:54 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 18:00:54 user nova-compute[72000]:         </nova:port>
Aug 16 18:00:54 user nova-compute[72000]:       </nova:ports>
Aug 16 18:00:54 user nova-compute[72000]:     </nova:instance>
Aug 16 18:00:54 user nova-compute[72000]:   </metadata>
Aug 16 18:00:54 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:00:54 user nova-compute[72000]:     <system>
Aug 16 18:00:54 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:00:54 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:00:54 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:00:54 user nova-compute[72000]:       <entry name="serial">49796cab-9592-4761-8acd-f54c1219ffb9</entry>
Aug 16 18:00:54 user nova-compute[72000]:       <entry name="uuid">49796cab-9592-4761-8acd-f54c1219ffb9</entry>
Aug 16 18:00:54 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:00:54 user nova-compute[72000]:     </system>
Aug 16 18:00:54 user nova-compute[72000]:   </sysinfo>
Aug 16 18:00:54 user nova-compute[72000]:   <os>
Aug 16 18:00:54 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:00:54 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:00:54 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:00:54 user nova-compute[72000]:   </os>
Aug 16 18:00:54 user nova-compute[72000]:   <features>
Aug 16 18:00:54 user nova-compute[72000]:     <acpi/>
Aug 16 18:00:54 user nova-compute[72000]:     <apic/>
Aug 16 18:00:54 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:00:54 user nova-compute[72000]:   </features>
Aug 16 18:00:54 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:00:54 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:00:54 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:00:54 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:00:54 user nova-compute[72000]:   </clock>
Aug 16 18:00:54 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:00:54 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:00:54 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:00:54 user nova-compute[72000]:   </cpu>
Aug 16 18:00:54 user nova-compute[72000]:   <devices>
Aug 16 18:00:54 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:00:54 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:00:54 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk"/>
Aug 16 18:00:54 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:00:54 user nova-compute[72000]:     </disk>
Aug 16 18:00:54 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:00:54 user nova-compute[72000]:       <mac address="fa:16:3e:2e:2a:35"/>
Aug 16 18:00:54 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:54 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:00:54 user nova-compute[72000]:       <target dev="tap05d4fd2c-6f"/>
Aug 16 18:00:54 user nova-compute[72000]:     </interface>
Aug 16 18:00:54 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:00:54 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/console.log" append="off"/>
Aug 16 18:00:54 user nova-compute[72000]:     </serial>
Aug 16 18:00:54 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:00:54 user nova-compute[72000]:     <video>
Aug 16 18:00:54 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:00:54 user nova-compute[72000]:     </video>
Aug 16 18:00:54 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:00:54 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:00:54 user nova-compute[72000]:     </rng>
Aug 16 18:00:54 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:00:54 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:00:54 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:00:54 user nova-compute[72000]:     </memballoon>
Aug 16 18:00:54 user nova-compute[72000]:   </devices>
Aug 16 18:00:54 user nova-compute[72000]: </domain>
Aug 16 18:00:54 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1572808618',display_name='tempest-VolumesAssistedSnapshotsTest-server-1572808618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1572808618',id=6,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8wmqoDL/hggERLBRduVW0o5Zj79xnzT2HL10/2sfWMRuXePHzkuGckupNM0bWdy5Cv1XIIblxGnl0yRhvzdaq7+GddOFQT427VOD2mXcF08Y4Vk26veXGAXoCFANdbsQ==',key_name='tempest-keypair-1415915389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92e666887ff3436ab1e0b019f9d7b888',ramdisk_id='',reservation_id='r-b7epkmpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1424008607',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1424008607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d450b2d680c4c018f87695f7eca039d',uuid=49796cab-9592-4761-8acd-f54c1219ffb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "address": "fa:16:3e:2e:2a:35", "network": {"id": "9a48b52d-ed41-41d0-a5f9-4a51a64b73ac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1097559854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e666887ff3436ab1e0b019f9d7b888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d4fd2c-6f", "ovs_interfaceid": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Converting VIF {"id": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "address": "fa:16:3e:2e:2a:35", "network": {"id": "9a48b52d-ed41-41d0-a5f9-4a51a64b73ac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1097559854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e666887ff3436ab1e0b019f9d7b888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d4fd2c-6f", "ovs_interfaceid": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:35,bridge_name='br-int',has_traffic_filtering=True,id=05d4fd2c-6f16-49b4-9ed2-b9451611d094,network=Network(9a48b52d-ed41-41d0-a5f9-4a51a64b73ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d4fd2c-6f') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG os_vif [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:35,bridge_name='br-int',has_traffic_filtering=True,id=05d4fd2c-6f16-49b4-9ed2-b9451611d094,network=Network(9a48b52d-ed41-41d0-a5f9-4a51a64b73ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d4fd2c-6f') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] No VIF found with MAC fa:16:3e:70:dd:99, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05d4fd2c-6f, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05d4fd2c-6f, col_values=(('external_ids', {'iface-id': '05d4fd2c-6f16-49b4-9ed2-b9451611d094', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:2a:35', 'vm-uuid': '49796cab-9592-4761-8acd-f54c1219ffb9'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:54 user nova-compute[72000]: INFO os_vif [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:2a:35,bridge_name='br-int',has_traffic_filtering=True,id=05d4fd2c-6f16-49b4-9ed2-b9451611d094,network=Network(9a48b52d-ed41-41d0-a5f9-4a51a64b73ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d4fd2c-6f')
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.334s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] No VIF found with MAC fa:16:3e:2e:2a:35, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:00:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.network.neutron [req-0668f24b-1553-4a73-8ae0-70463dba6eff req-9dbd45af-536a-40fd-a067-4501179a1e97 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Updated VIF entry in instance network info cache for port 1bbf38dc-2654-4e85-9dd9-000af10e5c3f. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.network.neutron [req-0668f24b-1553-4a73-8ae0-70463dba6eff req-9dbd45af-536a-40fd-a067-4501179a1e97 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Updating instance_info_cache with network_info: [{"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0668f24b-1553-4a73-8ae0-70463dba6eff req-9dbd45af-536a-40fd-a067-4501179a1e97 service nova] Releasing lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.policy [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eef79f384ee140a28ffa038f39c104e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d14e1ecd4624734942e175ef7bf14ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:00:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Creating image(s)
Aug 16 18:00:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "/opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "/opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "208b7d5e1c7ff1435357fabeac7e381c999db84d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "208b7d5e1c7ff1435357fabeac7e381c999db84d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d.part --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-54cf2c51-4179-41aa-ba5a-068a91021398 req-7c1a9764-bc5c-4efb-9da2-f5051b4fea48 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Received event network-vif-plugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54cf2c51-4179-41aa-ba5a-068a91021398 req-7c1a9764-bc5c-4efb-9da2-f5051b4fea48 service nova] Acquiring lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54cf2c51-4179-41aa-ba5a-068a91021398 req-7c1a9764-bc5c-4efb-9da2-f5051b4fea48 service nova] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54cf2c51-4179-41aa-ba5a-068a91021398 req-7c1a9764-bc5c-4efb-9da2-f5051b4fea48 service nova] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-54cf2c51-4179-41aa-ba5a-068a91021398 req-7c1a9764-bc5c-4efb-9da2-f5051b4fea48 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] No waiting events found dispatching network-vif-plugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:00:55 user nova-compute[72000]: WARNING nova.compute.manager [req-54cf2c51-4179-41aa-ba5a-068a91021398 req-7c1a9764-bc5c-4efb-9da2-f5051b4fea48 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Received unexpected event network-vif-plugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b for instance with vm_state active and task_state None.
Aug 16 18:00:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d.part --force-share --output=json" returned: 0 in 0.397s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:55 user nova-compute[72000]: DEBUG nova.virt.images [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] 9a0d1ddd-def5-4e2e-b574-2941a59345f4 was qcow2, converting to raw {{(pid=72000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 18:00:55 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:00:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d.part /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d.converted {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d.part /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d.converted" returned: 0 in 0.428s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d.converted --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:56 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Successfully created port: 5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:00:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d.converted --force-share --output=json" returned: 0 in 0.387s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "208b7d5e1c7ff1435357fabeac7e381c999db84d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.930s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d --force-share --output=json" returned: 0 in 0.256s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "208b7d5e1c7ff1435357fabeac7e381c999db84d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "208b7d5e1c7ff1435357fabeac7e381c999db84d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d --force-share --output=json" returned: 0 in 0.316s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d,backing_fmt=raw /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d,backing_fmt=raw /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk 1073741824" returned: 0 in 0.085s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "208b7d5e1c7ff1435357fabeac7e381c999db84d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.410s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d --force-share --output=json" returned: 0 in 0.314s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Cannot resize image /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG nova.objects.instance [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lazy-loading 'migration_context' on Instance uuid 0e7d8582-d732-4344-9f10-97ef34e8a391 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:00:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:00:57 user nova-compute[72000]: INFO nova.compute.claims [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Claim successful on node user
Aug 16 18:00:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:00:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Ensure instance console log exists: /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:00:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:58 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:00:58 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.101s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:00:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:00:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Successfully updated port: 5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "refresh_cache-0e7d8582-d732-4344-9f10-97ef34e8a391" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquired lock "refresh_cache-0e7d8582-d732-4344-9f10-97ef34e8a391" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.compute.manager [req-6436deb1-fa6c-4e01-a32f-5e62de43435a req-71349a28-3d59-4499-9e7b-9de77c7447de service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received event network-changed-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.compute.manager [req-6436deb1-fa6c-4e01-a32f-5e62de43435a req-71349a28-3d59-4499-9e7b-9de77c7447de service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Refreshing instance network info cache due to event network-changed-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6436deb1-fa6c-4e01-a32f-5e62de43435a req-71349a28-3d59-4499-9e7b-9de77c7447de service nova] Acquiring lock "refresh_cache-0e7d8582-d732-4344-9f10-97ef34e8a391" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.policy [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fce8ded340af4611b075dbf018443714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '675f746e18c248c7a817617bf6a08e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:00:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Creating image(s)
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.205s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:00:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk 1073741824" returned: 0 in 0.070s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Updating instance_info_cache with network_info: [{"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Successfully created port: 1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Releasing lock "refresh_cache-0e7d8582-d732-4344-9f10-97ef34e8a391" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Instance network_info: |[{"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6436deb1-fa6c-4e01-a32f-5e62de43435a req-71349a28-3d59-4499-9e7b-9de77c7447de service nova] Acquired lock "refresh_cache-0e7d8582-d732-4344-9f10-97ef34e8a391" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.network.neutron [req-6436deb1-fa6c-4e01-a32f-5e62de43435a req-71349a28-3d59-4499-9e7b-9de77c7447de service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Refreshing network info cache for port 5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Start _get_guest_xml network_info=[{"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T18:00:42Z,direct_url=<?>,disk_format='qcow2',id=9a0d1ddd-def5-4e2e-b574-2941a59345f4,min_disk=0,min_ram=0,name='',owner='3f5b5f36838249adb967cd21eab37c0c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T18:00:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'scsi', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '9a0d1ddd-def5-4e2e-b574-2941a59345f4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.234s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:00 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:01:00 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T18:00:42Z,direct_url=<?>,disk_format='qcow2',id=9a0d1ddd-def5-4e2e-b574-2941a59345f4,min_disk=0,min_ram=0,name='',owner='3f5b5f36838249adb967cd21eab37c0c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T18:00:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-976895130',display_name='tempest-AttachSCSIVolumeTestJSON-server-976895130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-976895130',id=8,image_ref='9a0d1ddd-def5-4e2e-b574-2941a59345f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqeyjKZ0PfZy3hfXxBqhiJQOO+5U2NOJ1KVyVUhjZF2iF5tUYghJQ6sbdZHqOfcHdN/9TAz1/m7XKA8UWZaTv/v9cFjpx5CifoipNfA+k+JL8Dc8yK4+w47b7XIw8Rs9A==',key_name='tempest-keypair-955334326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d14e1ecd4624734942e175ef7bf14ac',ramdisk_id='',reservation_id='r-uqfuxk21',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a0d1ddd-def5-4e2e-b574-2941a59345f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2142377259',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2142377259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef79f384ee140a28ffa038f39c104e7',uuid=0e7d8582-d732-4344-9f10-97ef34e8a391,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Converting VIF {"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:dd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5c59111e-ecfb-4d21-89e2-1f2b5f1c5042,network=Network(fc83f13c-fe44-45c7-a69b-d7b8bd907e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59111e-ec') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.objects.instance [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e7d8582-d732-4344-9f10-97ef34e8a391 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:01:00 user nova-compute[72000]:   <uuid>0e7d8582-d732-4344-9f10-97ef34e8a391</uuid>
Aug 16 18:01:00 user nova-compute[72000]:   <name>instance-00000008</name>
Aug 16 18:01:00 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:01:00 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:01:00 user nova-compute[72000]:   <metadata>
Aug 16 18:01:00 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:01:00 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:01:00 user nova-compute[72000]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-976895130</nova:name>
Aug 16 18:01:00 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:01:00</nova:creationTime>
Aug 16 18:01:00 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:01:00 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:01:00 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:01:00 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:01:00 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:01:00 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:01:00 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:01:00 user nova-compute[72000]:       <nova:owner>
Aug 16 18:01:00 user nova-compute[72000]:         <nova:user uuid="eef79f384ee140a28ffa038f39c104e7">tempest-AttachSCSIVolumeTestJSON-2142377259-project-member</nova:user>
Aug 16 18:01:00 user nova-compute[72000]:         <nova:project uuid="2d14e1ecd4624734942e175ef7bf14ac">tempest-AttachSCSIVolumeTestJSON-2142377259</nova:project>
Aug 16 18:01:00 user nova-compute[72000]:       </nova:owner>
Aug 16 18:01:00 user nova-compute[72000]:       <nova:root type="image" uuid="9a0d1ddd-def5-4e2e-b574-2941a59345f4"/>
Aug 16 18:01:00 user nova-compute[72000]:       <nova:ports>
Aug 16 18:01:00 user nova-compute[72000]:         <nova:port uuid="5c59111e-ecfb-4d21-89e2-1f2b5f1c5042">
Aug 16 18:01:00 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 18:01:00 user nova-compute[72000]:         </nova:port>
Aug 16 18:01:00 user nova-compute[72000]:       </nova:ports>
Aug 16 18:01:00 user nova-compute[72000]:     </nova:instance>
Aug 16 18:01:00 user nova-compute[72000]:   </metadata>
Aug 16 18:01:00 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:01:00 user nova-compute[72000]:     <system>
Aug 16 18:01:00 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:01:00 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:01:00 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:01:00 user nova-compute[72000]:       <entry name="serial">0e7d8582-d732-4344-9f10-97ef34e8a391</entry>
Aug 16 18:01:00 user nova-compute[72000]:       <entry name="uuid">0e7d8582-d732-4344-9f10-97ef34e8a391</entry>
Aug 16 18:01:00 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:01:00 user nova-compute[72000]:     </system>
Aug 16 18:01:00 user nova-compute[72000]:   </sysinfo>
Aug 16 18:01:00 user nova-compute[72000]:   <os>
Aug 16 18:01:00 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:01:00 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:01:00 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:01:00 user nova-compute[72000]:   </os>
Aug 16 18:01:00 user nova-compute[72000]:   <features>
Aug 16 18:01:00 user nova-compute[72000]:     <acpi/>
Aug 16 18:01:00 user nova-compute[72000]:     <apic/>
Aug 16 18:01:00 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:01:00 user nova-compute[72000]:   </features>
Aug 16 18:01:00 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:01:00 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:01:00 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:01:00 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:01:00 user nova-compute[72000]:   </clock>
Aug 16 18:01:00 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:01:00 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:01:00 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:01:00 user nova-compute[72000]:   </cpu>
Aug 16 18:01:00 user nova-compute[72000]:   <devices>
Aug 16 18:01:00 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:01:00 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:01:00 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk"/>
Aug 16 18:01:00 user nova-compute[72000]:       <target dev="sda" bus="scsi"/>
Aug 16 18:01:00 user nova-compute[72000]:       <address type="drive" controller="0" unit="0"/>
Aug 16 18:01:00 user nova-compute[72000]:     </disk>
Aug 16 18:01:00 user nova-compute[72000]:     <disk type="file" device="cdrom">
Aug 16 18:01:00 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 18:01:00 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk.config"/>
Aug 16 18:01:00 user nova-compute[72000]:       <target dev="sdb" bus="scsi"/>
Aug 16 18:01:00 user nova-compute[72000]:       <address type="drive" controller="0" unit="1"/>
Aug 16 18:01:00 user nova-compute[72000]:     </disk>
Aug 16 18:01:00 user nova-compute[72000]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 16 18:01:00 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:01:00 user nova-compute[72000]:       <mac address="fa:16:3e:51:dd:e0"/>
Aug 16 18:01:00 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:01:00 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:01:00 user nova-compute[72000]:       <target dev="tap5c59111e-ec"/>
Aug 16 18:01:00 user nova-compute[72000]:     </interface>
Aug 16 18:01:00 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:01:00 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/console.log" append="off"/>
Aug 16 18:01:00 user nova-compute[72000]:     </serial>
Aug 16 18:01:00 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:01:00 user nova-compute[72000]:     <video>
Aug 16 18:01:00 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:01:00 user nova-compute[72000]:     </video>
Aug 16 18:01:00 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:01:00 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:01:00 user nova-compute[72000]:     </rng>
Aug 16 18:01:00 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:01:00 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:01:00 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:01:00 user nova-compute[72000]:     </memballoon>
Aug 16 18:01:00 user nova-compute[72000]:   </devices>
Aug 16 18:01:00 user nova-compute[72000]: </domain>
Aug 16 18:01:00 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-976895130',display_name='tempest-AttachSCSIVolumeTestJSON-server-976895130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-976895130',id=8,image_ref='9a0d1ddd-def5-4e2e-b574-2941a59345f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqeyjKZ0PfZy3hfXxBqhiJQOO+5U2NOJ1KVyVUhjZF2iF5tUYghJQ6sbdZHqOfcHdN/9TAz1/m7XKA8UWZaTv/v9cFjpx5CifoipNfA+k+JL8Dc8yK4+w47b7XIw8Rs9A==',key_name='tempest-keypair-955334326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d14e1ecd4624734942e175ef7bf14ac',ramdisk_id='',reservation_id='r-uqfuxk21',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a0d1ddd-def5-4e2e-b574-2941a59345f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2142377259',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2142377259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef79f384ee140a28ffa038f39c104e7',uuid=0e7d8582-d732-4344-9f10-97ef34e8a391,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Converting VIF {"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:dd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5c59111e-ecfb-4d21-89e2-1f2b5f1c5042,network=Network(fc83f13c-fe44-45c7-a69b-d7b8bd907e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59111e-ec') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG os_vif [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:dd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5c59111e-ecfb-4d21-89e2-1f2b5f1c5042,network=Network(fc83f13c-fe44-45c7-a69b-d7b8bd907e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59111e-ec') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c59111e-ec, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c59111e-ec, col_values=(('external_ids', {'iface-id': '5c59111e-ecfb-4d21-89e2-1f2b5f1c5042', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:dd:e0', 'vm-uuid': '0e7d8582-d732-4344-9f10-97ef34e8a391'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Cannot resize image /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lazy-loading 'migration_context' on Instance uuid 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:00 user nova-compute[72000]: INFO os_vif [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:dd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5c59111e-ecfb-4d21-89e2-1f2b5f1c5042,network=Network(fc83f13c-fe44-45c7-a69b-d7b8bd907e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59111e-ec')
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Ensure instance console log exists: /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] No BDM found with device name sda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] No VIF found with MAC fa:16:3e:51:dd:e0, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:01:00 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Using config drive
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208860.8630176, 49796cab-9592-4761-8acd-f54c1219ffb9 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:01:00 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] VM Resumed (Lifecycle Event)
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:00 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Instance spawned successfully.
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:00 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208860.884615, 49796cab-9592-4761-8acd-f54c1219ffb9 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:01:00 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] VM Started (Lifecycle Event)
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.network.neutron [req-6436deb1-fa6c-4e01-a32f-5e62de43435a req-71349a28-3d59-4499-9e7b-9de77c7447de service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Updated VIF entry in instance network info cache for port 5c59111e-ecfb-4d21-89e2-1f2b5f1c5042. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:01:00 user nova-compute[72000]: DEBUG nova.network.neutron [req-6436deb1-fa6c-4e01-a32f-5e62de43435a req-71349a28-3d59-4499-9e7b-9de77c7447de service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Updating instance_info_cache with network_info: [{"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:01:00 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Creating config drive at /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk.config
Aug 16 18:01:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1o5xd68f {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6436deb1-fa6c-4e01-a32f-5e62de43435a req-71349a28-3d59-4499-9e7b-9de77c7447de service nova] Releasing lock "refresh_cache-0e7d8582-d732-4344-9f10-97ef34e8a391" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.compute.manager [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Took 14.89 seconds to spawn the instance on the hypervisor.
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1o5xd68f" returned: 0 in 0.069s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Successfully updated port: 1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquired lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Instance spawned successfully.
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-dc3583b6-f6a3-4f35-a49b-8edc0b00a372 req-fad08d19-71c9-461c-b155-bbbd4e12316b service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-changed-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-dc3583b6-f6a3-4f35-a49b-8edc0b00a372 req-fad08d19-71c9-461c-b155-bbbd4e12316b service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Refreshing instance network info cache due to event network-changed-1a9af2dc-bef9-4a0f-993d-1b61022dda5d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dc3583b6-f6a3-4f35-a49b-8edc0b00a372 req-fad08d19-71c9-461c-b155-bbbd4e12316b service nova] Acquiring lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208861.008679, b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] VM Resumed (Lifecycle Event)
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208861.017993, b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] VM Started (Lifecycle Event)
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.compute.manager [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Took 16.69 seconds to build instance.
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-97c833db-8169-4a48-91ef-500c64f163a6 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "49796cab-9592-4761-8acd-f54c1219ffb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.893s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.compute.claims [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Claim successful on node user
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.compute.manager [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Took 10.88 seconds to spawn the instance on the hypervisor.
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.compute.manager [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Took 12.22 seconds to build instance.
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8e1e74ee-278d-4b4d-b89a-4a8e45c30a70 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.412s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updating instance_info_cache with network_info: [{"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Releasing lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Instance network_info: |[{"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dc3583b6-f6a3-4f35-a49b-8edc0b00a372 req-fad08d19-71c9-461c-b155-bbbd4e12316b service nova] Acquired lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.network.neutron [req-dc3583b6-f6a3-4f35-a49b-8edc0b00a372 req-fad08d19-71c9-461c-b155-bbbd4e12316b service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Refreshing network info cache for port 1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Start _get_guest_xml network_info=[{"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-cd6f254a-afaa-4c9a-aac9-3175f1fd5adf req-6a0e9506-9ca4-49fa-a260-2ec852c91946 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd6f254a-afaa-4c9a-aac9-3175f1fd5adf req-6a0e9506-9ca4-49fa-a260-2ec852c91946 service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd6f254a-afaa-4c9a-aac9-3175f1fd5adf req-6a0e9506-9ca4-49fa-a260-2ec852c91946 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd6f254a-afaa-4c9a-aac9-3175f1fd5adf req-6a0e9506-9ca4-49fa-a260-2ec852c91946 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-cd6f254a-afaa-4c9a-aac9-3175f1fd5adf req-6a0e9506-9ca4-49fa-a260-2ec852c91946 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:01 user nova-compute[72000]: WARNING nova.compute.manager [req-cd6f254a-afaa-4c9a-aac9-3175f1fd5adf req-6a0e9506-9ca4-49fa-a260-2ec852c91946 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state active and task_state None.
Aug 16 18:01:01 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:01:01 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71010681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71010681',id=9,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBItXYqUoCpbqB6nSOayr8Vmqi37fPWCEeevSnocKUkNBleJi6mxX7ey3iNWYzB6KMn1zWiw2auNdGp5nEMlxZXHrlq22uXueVa1zdbdPsbcd4KjbcH3ueYvIsSHmeZYEw==',key_name='tempest-keypair-1147753708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='675f746e18c248c7a817617bf6a08e0e',ramdisk_id='',reservation_id='r-ae811ic6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1487068983',owner_user_name='tempest-TaggedAttachmentsTest-1487068983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce8ded340af4611b075dbf018443714',uuid=24b1035b-ae88-49a1-94f6-edc05ffce52a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converting VIF {"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f8:fb,bridge_name='br-int',has_traffic_filtering=True,id=1a9af2dc-bef9-4a0f-993d-1b61022dda5d,network=Network(24151e0c-d32a-4c64-8866-25d0d95386d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9af2dc-be') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lazy-loading 'pci_devices' on Instance uuid 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:01:01 user nova-compute[72000]:   <uuid>24b1035b-ae88-49a1-94f6-edc05ffce52a</uuid>
Aug 16 18:01:01 user nova-compute[72000]:   <name>instance-00000009</name>
Aug 16 18:01:01 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:01:01 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:01:01 user nova-compute[72000]:   <metadata>
Aug 16 18:01:01 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:01:01 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:01:01 user nova-compute[72000]:       <nova:name>tempest-device-tagging-server-71010681</nova:name>
Aug 16 18:01:01 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:01:01</nova:creationTime>
Aug 16 18:01:01 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:01:01 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:01:01 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:01:01 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:01:01 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:01:01 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:01:01 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:01:01 user nova-compute[72000]:       <nova:owner>
Aug 16 18:01:01 user nova-compute[72000]:         <nova:user uuid="fce8ded340af4611b075dbf018443714">tempest-TaggedAttachmentsTest-1487068983-project-member</nova:user>
Aug 16 18:01:01 user nova-compute[72000]:         <nova:project uuid="675f746e18c248c7a817617bf6a08e0e">tempest-TaggedAttachmentsTest-1487068983</nova:project>
Aug 16 18:01:01 user nova-compute[72000]:       </nova:owner>
Aug 16 18:01:01 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:01:01 user nova-compute[72000]:       <nova:ports>
Aug 16 18:01:01 user nova-compute[72000]:         <nova:port uuid="1a9af2dc-bef9-4a0f-993d-1b61022dda5d">
Aug 16 18:01:01 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 18:01:01 user nova-compute[72000]:         </nova:port>
Aug 16 18:01:01 user nova-compute[72000]:       </nova:ports>
Aug 16 18:01:01 user nova-compute[72000]:     </nova:instance>
Aug 16 18:01:01 user nova-compute[72000]:   </metadata>
Aug 16 18:01:01 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:01:01 user nova-compute[72000]:     <system>
Aug 16 18:01:01 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:01:01 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:01:01 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:01:01 user nova-compute[72000]:       <entry name="serial">24b1035b-ae88-49a1-94f6-edc05ffce52a</entry>
Aug 16 18:01:01 user nova-compute[72000]:       <entry name="uuid">24b1035b-ae88-49a1-94f6-edc05ffce52a</entry>
Aug 16 18:01:01 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:01:01 user nova-compute[72000]:     </system>
Aug 16 18:01:01 user nova-compute[72000]:   </sysinfo>
Aug 16 18:01:01 user nova-compute[72000]:   <os>
Aug 16 18:01:01 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:01:01 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:01:01 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:01:01 user nova-compute[72000]:   </os>
Aug 16 18:01:01 user nova-compute[72000]:   <features>
Aug 16 18:01:01 user nova-compute[72000]:     <acpi/>
Aug 16 18:01:01 user nova-compute[72000]:     <apic/>
Aug 16 18:01:01 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:01:01 user nova-compute[72000]:   </features>
Aug 16 18:01:01 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:01:01 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:01:01 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:01:01 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:01:01 user nova-compute[72000]:   </clock>
Aug 16 18:01:01 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:01:01 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:01:01 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:01:01 user nova-compute[72000]:   </cpu>
Aug 16 18:01:01 user nova-compute[72000]:   <devices>
Aug 16 18:01:01 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:01:01 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:01:01 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk"/>
Aug 16 18:01:01 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:01:01 user nova-compute[72000]:     </disk>
Aug 16 18:01:01 user nova-compute[72000]:     <disk type="file" device="cdrom">
Aug 16 18:01:01 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 18:01:01 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk.config"/>
Aug 16 18:01:01 user nova-compute[72000]:       <target dev="hda" bus="ide"/>
Aug 16 18:01:01 user nova-compute[72000]:     </disk>
Aug 16 18:01:01 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:01:01 user nova-compute[72000]:       <mac address="fa:16:3e:c1:f8:fb"/>
Aug 16 18:01:01 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:01:01 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:01:01 user nova-compute[72000]:       <target dev="tap1a9af2dc-be"/>
Aug 16 18:01:01 user nova-compute[72000]:     </interface>
Aug 16 18:01:01 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:01:01 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/console.log" append="off"/>
Aug 16 18:01:01 user nova-compute[72000]:     </serial>
Aug 16 18:01:01 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:01:01 user nova-compute[72000]:     <video>
Aug 16 18:01:01 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:01:01 user nova-compute[72000]:     </video>
Aug 16 18:01:01 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:01:01 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:01:01 user nova-compute[72000]:     </rng>
Aug 16 18:01:01 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:01:01 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:01:01 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:01:01 user nova-compute[72000]:     </memballoon>
Aug 16 18:01:01 user nova-compute[72000]:   </devices>
Aug 16 18:01:01 user nova-compute[72000]: </domain>
Aug 16 18:01:01 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71010681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71010681',id=9,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBItXYqUoCpbqB6nSOayr8Vmqi37fPWCEeevSnocKUkNBleJi6mxX7ey3iNWYzB6KMn1zWiw2auNdGp5nEMlxZXHrlq22uXueVa1zdbdPsbcd4KjbcH3ueYvIsSHmeZYEw==',key_name='tempest-keypair-1147753708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='675f746e18c248c7a817617bf6a08e0e',ramdisk_id='',reservation_id='r-ae811ic6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1487068983',owner_user_name='tempest-TaggedAttachmentsTest-1487068983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce8ded340af4611b075dbf018443714',uuid=24b1035b-ae88-49a1-94f6-edc05ffce52a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converting VIF {"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f8:fb,bridge_name='br-int',has_traffic_filtering=True,id=1a9af2dc-bef9-4a0f-993d-1b61022dda5d,network=Network(24151e0c-d32a-4c64-8866-25d0d95386d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9af2dc-be') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG os_vif [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f8:fb,bridge_name='br-int',has_traffic_filtering=True,id=1a9af2dc-bef9-4a0f-993d-1b61022dda5d,network=Network(24151e0c-d32a-4c64-8866-25d0d95386d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9af2dc-be') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a9af2dc-be, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a9af2dc-be, col_values=(('external_ids', {'iface-id': '1a9af2dc-bef9-4a0f-993d-1b61022dda5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:f8:fb', 'vm-uuid': '24b1035b-ae88-49a1-94f6-edc05ffce52a'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:01 user nova-compute[72000]: INFO os_vif [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:f8:fb,bridge_name='br-int',has_traffic_filtering=True,id=1a9af2dc-bef9-4a0f-993d-1b61022dda5d,network=Network(24151e0c-d32a-4c64-8866-25d0d95386d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9af2dc-be')
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] No BDM found with device name hda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] No VIF found with MAC fa:16:3e:c1:f8:fb, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Using config drive
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:01:01 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:01:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Creating config drive at /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk.config
Aug 16 18:01:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp20dqev01 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.738s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp20dqev01" returned: 0 in 0.072s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:01:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:01:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG nova.policy [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed0e92bcc29a4b699e55670cd593fbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ad8e66da964d339b229c1a74f94e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:01:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Creating image(s)
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "/opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "/opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG nova.network.neutron [req-dc3583b6-f6a3-4f35-a49b-8edc0b00a372 req-fad08d19-71c9-461c-b155-bbbd4e12316b service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updated VIF entry in instance network info cache for port 1a9af2dc-bef9-4a0f-993d-1b61022dda5d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG nova.network.neutron [req-dc3583b6-f6a3-4f35-a49b-8edc0b00a372 req-fad08d19-71c9-461c-b155-bbbd4e12316b service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updating instance_info_cache with network_info: [{"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dc3583b6-f6a3-4f35-a49b-8edc0b00a372 req-fad08d19-71c9-461c-b155-bbbd4e12316b service nova] Releasing lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.251s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.269s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk 1073741824" returned: 0 in 0.059s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.233s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Cannot resize image /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lazy-loading 'migration_context' on Instance uuid cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Ensure instance console log exists: /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Successfully created port: 0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-cc18be4c-493f-4a7f-8d24-5c14c95e5f2c req-411c8230-4c9d-4249-99a8-2a068c03cbb0 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cc18be4c-493f-4a7f-8d24-5c14c95e5f2c req-411c8230-4c9d-4249-99a8-2a068c03cbb0 service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cc18be4c-493f-4a7f-8d24-5c14c95e5f2c req-411c8230-4c9d-4249-99a8-2a068c03cbb0 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cc18be4c-493f-4a7f-8d24-5c14c95e5f2c req-411c8230-4c9d-4249-99a8-2a068c03cbb0 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-cc18be4c-493f-4a7f-8d24-5c14c95e5f2c req-411c8230-4c9d-4249-99a8-2a068c03cbb0 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:03 user nova-compute[72000]: WARNING nova.compute.manager [req-cc18be4c-493f-4a7f-8d24-5c14c95e5f2c req-411c8230-4c9d-4249-99a8-2a068c03cbb0 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state active and task_state None.
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-c9ac4c24-c6c8-4278-9ebd-30e1a63369fd req-5cefaafa-98be-4fbf-aa12-321c32994c0e service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Received event network-vif-plugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c9ac4c24-c6c8-4278-9ebd-30e1a63369fd req-5cefaafa-98be-4fbf-aa12-321c32994c0e service nova] Acquiring lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c9ac4c24-c6c8-4278-9ebd-30e1a63369fd req-5cefaafa-98be-4fbf-aa12-321c32994c0e service nova] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c9ac4c24-c6c8-4278-9ebd-30e1a63369fd req-5cefaafa-98be-4fbf-aa12-321c32994c0e service nova] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-c9ac4c24-c6c8-4278-9ebd-30e1a63369fd req-5cefaafa-98be-4fbf-aa12-321c32994c0e service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] No waiting events found dispatching network-vif-plugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:03 user nova-compute[72000]: WARNING nova.compute.manager [req-c9ac4c24-c6c8-4278-9ebd-30e1a63369fd req-5cefaafa-98be-4fbf-aa12-321c32994c0e service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Received unexpected event network-vif-plugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd for instance with vm_state active and task_state None.
Aug 16 18:01:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-bae9ac64-813a-4d1d-9529-9f0f622b871e req-77d07be2-3956-4add-b780-ac596a2f153e service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-plugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bae9ac64-813a-4d1d-9529-9f0f622b871e req-77d07be2-3956-4add-b780-ac596a2f153e service nova] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bae9ac64-813a-4d1d-9529-9f0f622b871e req-77d07be2-3956-4add-b780-ac596a2f153e service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bae9ac64-813a-4d1d-9529-9f0f622b871e req-77d07be2-3956-4add-b780-ac596a2f153e service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-bae9ac64-813a-4d1d-9529-9f0f622b871e req-77d07be2-3956-4add-b780-ac596a2f153e service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] No waiting events found dispatching network-vif-plugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:04 user nova-compute[72000]: WARNING nova.compute.manager [req-bae9ac64-813a-4d1d-9529-9f0f622b871e req-77d07be2-3956-4add-b780-ac596a2f153e service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received unexpected event network-vif-plugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d for instance with vm_state building and task_state spawning.
Aug 16 18:01:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.network.neutron [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Successfully updated port: 0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Skipping network cache update for instance because it is Building. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Skipping network cache update for instance because it is Building. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Skipping network cache update for instance because it is Building. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "refresh_cache-cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquired lock "refresh_cache-cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.network.neutron [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.network.neutron [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Received event network-vif-plugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] Acquiring lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] No waiting events found dispatching network-vif-plugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:05 user nova-compute[72000]: WARNING nova.compute.manager [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Received unexpected event network-vif-plugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd for instance with vm_state active and task_state None.
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received event network-changed-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Refreshing instance network info cache due to event network-changed-0c92204c-43a6-4966-8a04-b04fdc1b1b3a. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:01:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] Acquiring lock "refresh_cache-cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.network.neutron [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Updating instance_info_cache with network_info: [{"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Releasing lock "refresh_cache-cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Instance network_info: |[{"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] Acquired lock "refresh_cache-cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.network.neutron [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Refreshing network info cache for port 0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Start _get_guest_xml network_info=[{"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:01:06 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:01:06 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1630113568',display_name='tempest-TestVolumeSwap-server-1630113568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1630113568',id=10,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOXnbCRoL7d1Ai6REwXMAziqaCCFXlhYo2bhCp3RsgVQjFRQdJB5ewmjq9ggftUq8kuSmdpBVsLZdbgqnJcGAuaeccLM4dsdiw5CiChQYin2GMsI6zz2vzEJNfVwDbibQ==',key_name='tempest-keypair-1153245667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9ad8e66da964d339b229c1a74f94e4e',ramdisk_id='',reservation_id='r-mdny771q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-364823705',owner_user_name='tempest-TestVolumeSwap-364823705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:01:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed0e92bcc29a4b699e55670cd593fbcc',uuid=cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Converting VIF {"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:61,bridge_name='br-int',has_traffic_filtering=True,id=0c92204c-43a6-4966-8a04-b04fdc1b1b3a,network=Network(1b89f99d-2e82-4169-a9b0-e57f460c61f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c92204c-43') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lazy-loading 'pci_devices' on Instance uuid cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:01:06 user nova-compute[72000]:   <uuid>cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6</uuid>
Aug 16 18:01:06 user nova-compute[72000]:   <name>instance-0000000a</name>
Aug 16 18:01:06 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:01:06 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:01:06 user nova-compute[72000]:   <metadata>
Aug 16 18:01:06 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:01:06 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:01:06 user nova-compute[72000]:       <nova:name>tempest-TestVolumeSwap-server-1630113568</nova:name>
Aug 16 18:01:06 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:01:06</nova:creationTime>
Aug 16 18:01:06 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:01:06 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:01:06 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:01:06 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:01:06 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:01:06 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:01:06 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:01:06 user nova-compute[72000]:       <nova:owner>
Aug 16 18:01:06 user nova-compute[72000]:         <nova:user uuid="ed0e92bcc29a4b699e55670cd593fbcc">tempest-TestVolumeSwap-364823705-project-member</nova:user>
Aug 16 18:01:06 user nova-compute[72000]:         <nova:project uuid="e9ad8e66da964d339b229c1a74f94e4e">tempest-TestVolumeSwap-364823705</nova:project>
Aug 16 18:01:06 user nova-compute[72000]:       </nova:owner>
Aug 16 18:01:06 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:01:06 user nova-compute[72000]:       <nova:ports>
Aug 16 18:01:06 user nova-compute[72000]:         <nova:port uuid="0c92204c-43a6-4966-8a04-b04fdc1b1b3a">
Aug 16 18:01:06 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:01:06 user nova-compute[72000]:         </nova:port>
Aug 16 18:01:06 user nova-compute[72000]:       </nova:ports>
Aug 16 18:01:06 user nova-compute[72000]:     </nova:instance>
Aug 16 18:01:06 user nova-compute[72000]:   </metadata>
Aug 16 18:01:06 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:01:06 user nova-compute[72000]:     <system>
Aug 16 18:01:06 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:01:06 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:01:06 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:01:06 user nova-compute[72000]:       <entry name="serial">cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6</entry>
Aug 16 18:01:06 user nova-compute[72000]:       <entry name="uuid">cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6</entry>
Aug 16 18:01:06 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:01:06 user nova-compute[72000]:     </system>
Aug 16 18:01:06 user nova-compute[72000]:   </sysinfo>
Aug 16 18:01:06 user nova-compute[72000]:   <os>
Aug 16 18:01:06 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:01:06 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:01:06 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:01:06 user nova-compute[72000]:   </os>
Aug 16 18:01:06 user nova-compute[72000]:   <features>
Aug 16 18:01:06 user nova-compute[72000]:     <acpi/>
Aug 16 18:01:06 user nova-compute[72000]:     <apic/>
Aug 16 18:01:06 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:01:06 user nova-compute[72000]:   </features>
Aug 16 18:01:06 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:01:06 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:01:06 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:01:06 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:01:06 user nova-compute[72000]:   </clock>
Aug 16 18:01:06 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:01:06 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:01:06 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:01:06 user nova-compute[72000]:   </cpu>
Aug 16 18:01:06 user nova-compute[72000]:   <devices>
Aug 16 18:01:06 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:01:06 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:01:06 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk"/>
Aug 16 18:01:06 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:01:06 user nova-compute[72000]:     </disk>
Aug 16 18:01:06 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:01:06 user nova-compute[72000]:       <mac address="fa:16:3e:aa:05:61"/>
Aug 16 18:01:06 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:01:06 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:01:06 user nova-compute[72000]:       <target dev="tap0c92204c-43"/>
Aug 16 18:01:06 user nova-compute[72000]:     </interface>
Aug 16 18:01:06 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:01:06 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/console.log" append="off"/>
Aug 16 18:01:06 user nova-compute[72000]:     </serial>
Aug 16 18:01:06 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:01:06 user nova-compute[72000]:     <video>
Aug 16 18:01:06 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:01:06 user nova-compute[72000]:     </video>
Aug 16 18:01:06 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:01:06 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:01:06 user nova-compute[72000]:     </rng>
Aug 16 18:01:06 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:01:06 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:01:06 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:01:06 user nova-compute[72000]:     </memballoon>
Aug 16 18:01:06 user nova-compute[72000]:   </devices>
Aug 16 18:01:06 user nova-compute[72000]: </domain>
Aug 16 18:01:06 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1630113568',display_name='tempest-TestVolumeSwap-server-1630113568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1630113568',id=10,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOXnbCRoL7d1Ai6REwXMAziqaCCFXlhYo2bhCp3RsgVQjFRQdJB5ewmjq9ggftUq8kuSmdpBVsLZdbgqnJcGAuaeccLM4dsdiw5CiChQYin2GMsI6zz2vzEJNfVwDbibQ==',key_name='tempest-keypair-1153245667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9ad8e66da964d339b229c1a74f94e4e',ramdisk_id='',reservation_id='r-mdny771q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-364823705',owner_user_name='tempest-TestVolumeSwap-364823705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:01:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed0e92bcc29a4b699e55670cd593fbcc',uuid=cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Converting VIF {"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:61,bridge_name='br-int',has_traffic_filtering=True,id=0c92204c-43a6-4966-8a04-b04fdc1b1b3a,network=Network(1b89f99d-2e82-4169-a9b0-e57f460c61f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c92204c-43') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG os_vif [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:61,bridge_name='br-int',has_traffic_filtering=True,id=0c92204c-43a6-4966-8a04-b04fdc1b1b3a,network=Network(1b89f99d-2e82-4169-a9b0-e57f460c61f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c92204c-43') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c92204c-43, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c92204c-43, col_values=(('external_ids', {'iface-id': '0c92204c-43a6-4966-8a04-b04fdc1b1b3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:05:61', 'vm-uuid': 'cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:06 user nova-compute[72000]: INFO os_vif [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:05:61,bridge_name='br-int',has_traffic_filtering=True,id=0c92204c-43a6-4966-8a04-b04fdc1b1b3a,network=Network(1b89f99d-2e82-4169-a9b0-e57f460c61f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c92204c-43')
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:01:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] No VIF found with MAC fa:16:3e:aa:05:61, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-7a5f85cc-a5ef-4ce8-b970-2e60d899a9e2 req-8d3f7144-a131-4ce8-980a-7b450c006de1 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-plugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7a5f85cc-a5ef-4ce8-b970-2e60d899a9e2 req-8d3f7144-a131-4ce8-980a-7b450c006de1 service nova] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7a5f85cc-a5ef-4ce8-b970-2e60d899a9e2 req-8d3f7144-a131-4ce8-980a-7b450c006de1 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7a5f85cc-a5ef-4ce8-b970-2e60d899a9e2 req-8d3f7144-a131-4ce8-980a-7b450c006de1 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-7a5f85cc-a5ef-4ce8-b970-2e60d899a9e2 req-8d3f7144-a131-4ce8-980a-7b450c006de1 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] No waiting events found dispatching network-vif-plugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:07 user nova-compute[72000]: WARNING nova.compute.manager [req-7a5f85cc-a5ef-4ce8-b970-2e60d899a9e2 req-8d3f7144-a131-4ce8-980a-7b450c006de1 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received unexpected event network-vif-plugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d for instance with vm_state building and task_state spawning.
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208867.224719, 0e7d8582-d732-4344-9f10-97ef34e8a391 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] VM Resumed (Lifecycle Event)
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Instance spawned successfully.
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.network.neutron [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Updated VIF entry in instance network info cache for port 0c92204c-43a6-4966-8a04-b04fdc1b1b3a. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.network.neutron [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Updating instance_info_cache with network_info: [{"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f23eeca4-dc2c-4f40-93b2-b434ce62948d req-e1ec5f7c-88e1-47a7-9337-23756379b60a service nova] Releasing lock "refresh_cache-cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208867.2250206, 0e7d8582-d732-4344-9f10-97ef34e8a391 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] VM Started (Lifecycle Event)
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Took 12.65 seconds to spawn the instance on the hypervisor.
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208867.5557785, 24b1035b-ae88-49a1-94f6-edc05ffce52a => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] VM Resumed (Lifecycle Event)
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Instance spawned successfully.
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Took 14.58 seconds to build instance.
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208867.5637963, 24b1035b-ae88-49a1-94f6-edc05ffce52a => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] VM Started (Lifecycle Event)
Aug 16 18:01:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e75a2fb0-8d5c-4565-b2c2-18944512d703 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.773s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Took 8.29 seconds to spawn the instance on the hypervisor.
Aug 16 18:01:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:07 user nova-compute[72000]: INFO nova.compute.manager [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Took 10.08 seconds to build instance.
Aug 16 18:01:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0645d5a0-2fe1-44ba-ad82-c0f294890ddb tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.251s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-f69b1cbd-80e6-4355-af99-d7b6e8145ba2 req-1bfe88f5-a234-4ef0-886a-330f7964ccbe service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f69b1cbd-80e6-4355-af99-d7b6e8145ba2 req-1bfe88f5-a234-4ef0-886a-330f7964ccbe service nova] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f69b1cbd-80e6-4355-af99-d7b6e8145ba2 req-1bfe88f5-a234-4ef0-886a-330f7964ccbe service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f69b1cbd-80e6-4355-af99-d7b6e8145ba2 req-1bfe88f5-a234-4ef0-886a-330f7964ccbe service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-f69b1cbd-80e6-4355-af99-d7b6e8145ba2 req-1bfe88f5-a234-4ef0-886a-330f7964ccbe service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] No waiting events found dispatching network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:09 user nova-compute[72000]: WARNING nova.compute.manager [req-f69b1cbd-80e6-4355-af99-d7b6e8145ba2 req-1bfe88f5-a234-4ef0-886a-330f7964ccbe service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received unexpected event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f for instance with vm_state active and task_state None.
Aug 16 18:01:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:01:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:10 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] No waiting events found dispatching network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:11 user nova-compute[72000]: WARNING nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received unexpected event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f for instance with vm_state active and task_state None.
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received event network-vif-plugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Acquiring lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] No waiting events found dispatching network-vif-plugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:11 user nova-compute[72000]: WARNING nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received unexpected event network-vif-plugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 for instance with vm_state active and task_state None.
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received event network-vif-plugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Acquiring lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] No waiting events found dispatching network-vif-plugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:11 user nova-compute[72000]: WARNING nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received unexpected event network-vif-plugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 for instance with vm_state active and task_state None.
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received event network-vif-plugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] No waiting events found dispatching network-vif-plugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:11 user nova-compute[72000]: WARNING nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received unexpected event network-vif-plugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a for instance with vm_state building and task_state spawning.
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received event network-vif-plugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] No waiting events found dispatching network-vif-plugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:11 user nova-compute[72000]: WARNING nova.compute.manager [req-f6aa8b8e-bf88-41c9-990d-8e1287bc6153 req-54a4a055-bb6a-4591-b5ac-3a4d9fafea55 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received unexpected event network-vif-plugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a for instance with vm_state building and task_state spawning.
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json" returned: 0 in 0.403s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208871.733755, cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:01:11 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] VM Resumed (Lifecycle Event)
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:11 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Instance spawned successfully.
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:01:11 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208871.7346375, cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:01:11 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] VM Started (Lifecycle Event)
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:01:11 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:01:11 user nova-compute[72000]: INFO nova.compute.manager [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Took 9.65 seconds to spawn the instance on the hypervisor.
Aug 16 18:01:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:12 user nova-compute[72000]: INFO nova.compute.manager [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Took 10.85 seconds to build instance.
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-635dc0ab-33c7-489a-8b80-67765c761da5 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.137s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:01:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:01:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:16 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:01:16 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:01:16 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7487MB free_disk=24.094730377197266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:01:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 0654db58-a031-4998-bb1e-d4fa7f2a7046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a8532341-62b3-4c58-b3d8-db5440ad08c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 49796cab-9592-4761-8acd-f54c1219ffb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 0e7d8582-d732-4344-9f10-97ef34e8a391 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 24b1035b-ae88-49a1-94f6-edc05ffce52a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.manager [req-60cbcd79-fb19-4008-880f-042a735c6e29 req-5e69c2b6-58e8-4e1b-9c06-15f66508c31f service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received event network-vif-plugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-60cbcd79-fb19-4008-880f-042a735c6e29 req-5e69c2b6-58e8-4e1b-9c06-15f66508c31f service nova] Acquiring lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-60cbcd79-fb19-4008-880f-042a735c6e29 req-5e69c2b6-58e8-4e1b-9c06-15f66508c31f service nova] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-60cbcd79-fb19-4008-880f-042a735c6e29 req-5e69c2b6-58e8-4e1b-9c06-15f66508c31f service nova] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:17 user nova-compute[72000]: DEBUG nova.compute.manager [req-60cbcd79-fb19-4008-880f-042a735c6e29 req-5e69c2b6-58e8-4e1b-9c06-15f66508c31f service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] No waiting events found dispatching network-vif-plugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:17 user nova-compute[72000]: WARNING nova.compute.manager [req-60cbcd79-fb19-4008-880f-042a735c6e29 req-5e69c2b6-58e8-4e1b-9c06-15f66508c31f service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received unexpected event network-vif-plugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 for instance with vm_state active and task_state None.
Aug 16 18:01:18 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:01:18 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:01:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:01:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.173s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-43c50a79-9f1b-4297-8677-167f3f1a9e32 req-9a73efa3-82f7-4754-a326-e75e3e0917de service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received event network-vif-plugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:01:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-43c50a79-9f1b-4297-8677-167f3f1a9e32 req-9a73efa3-82f7-4754-a326-e75e3e0917de service nova] Acquiring lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:01:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-43c50a79-9f1b-4297-8677-167f3f1a9e32 req-9a73efa3-82f7-4754-a326-e75e3e0917de service nova] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:01:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-43c50a79-9f1b-4297-8677-167f3f1a9e32 req-9a73efa3-82f7-4754-a326-e75e3e0917de service nova] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:01:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-43c50a79-9f1b-4297-8677-167f3f1a9e32 req-9a73efa3-82f7-4754-a326-e75e3e0917de service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] No waiting events found dispatching network-vif-plugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:01:20 user nova-compute[72000]: WARNING nova.compute.manager [req-43c50a79-9f1b-4297-8677-167f3f1a9e32 req-9a73efa3-82f7-4754-a326-e75e3e0917de service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received unexpected event network-vif-plugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 for instance with vm_state active and task_state None.
Aug 16 18:01:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:01:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:01:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:01:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:01:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:01:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-eadff294-6d64-4fc4-95e3-5979c4df354f req-9de6082e-14c3-44fd-9127-f40b02a0fb6d service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received event network-changed-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-eadff294-6d64-4fc4-95e3-5979c4df354f req-9de6082e-14c3-44fd-9127-f40b02a0fb6d service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Refreshing instance network info cache due to event network-changed-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:02:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-eadff294-6d64-4fc4-95e3-5979c4df354f req-9de6082e-14c3-44fd-9127-f40b02a0fb6d service nova] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-eadff294-6d64-4fc4-95e3-5979c4df354f req-9de6082e-14c3-44fd-9127-f40b02a0fb6d service nova] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-eadff294-6d64-4fc4-95e3-5979c4df354f req-9de6082e-14c3-44fd-9127-f40b02a0fb6d service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Refreshing network info cache for port 6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:02:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-eadff294-6d64-4fc4-95e3-5979c4df354f req-9de6082e-14c3-44fd-9127-f40b02a0fb6d service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated VIF entry in instance network info cache for port 6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:02:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-eadff294-6d64-4fc4-95e3-5979c4df354f req-9de6082e-14c3-44fd-9127-f40b02a0fb6d service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-eadff294-6d64-4fc4-95e3-5979c4df354f req-9de6082e-14c3-44fd-9127-f40b02a0fb6d service nova] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:02:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:02:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:02:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:02:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "682dbab8-ba72-4379-abaf-c35c9fff9d31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:02:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:12 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:02:12 user nova-compute[72000]: INFO nova.compute.claims [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Claim successful on node user
Aug 16 18:02:13 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:02:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:02:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG nova.policy [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d24985b850c46e3bdb31296af169a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae4b7b47c8c9413d828928c6132eb104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:02:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Creating image(s)
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "/opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "/opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "/opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.326s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.200s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk 1073741824" returned: 0 in 0.064s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.260s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Successfully created port: 8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Cannot resize image /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lazy-loading 'migration_context' on Instance uuid 682dbab8-ba72-4379-abaf-c35c9fff9d31 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Ensure instance console log exists: /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-6a29a513-9e9a-4b7d-b419-8450b0b4721d req-0eea84ff-4dcf-45b9-a397-4a22a8206a44 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-changed-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-6a29a513-9e9a-4b7d-b419-8450b0b4721d req-0eea84ff-4dcf-45b9-a397-4a22a8206a44 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Refreshing instance network info cache due to event network-changed-548341b0-47da-4962-b21a-fd4cc4118bdc. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6a29a513-9e9a-4b7d-b419-8450b0b4721d req-0eea84ff-4dcf-45b9-a397-4a22a8206a44 service nova] Acquiring lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6a29a513-9e9a-4b7d-b419-8450b0b4721d req-0eea84ff-4dcf-45b9-a397-4a22a8206a44 service nova] Acquired lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.network.neutron [req-6a29a513-9e9a-4b7d-b419-8450b0b4721d req-0eea84ff-4dcf-45b9-a397-4a22a8206a44 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Refreshing network info cache for port 548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Updating instance_info_cache with network_info: [{"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Successfully updated port: 8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "refresh_cache-682dbab8-ba72-4379-abaf-c35c9fff9d31" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquired lock "refresh_cache-682dbab8-ba72-4379-abaf-c35c9fff9d31" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-1933d075-f457-41a7-8613-6c8b91a550a0 req-71fded20-7a25-4e0f-9bfc-5feea2cb3d7b service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Received event network-changed-8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-1933d075-f457-41a7-8613-6c8b91a550a0 req-71fded20-7a25-4e0f-9bfc-5feea2cb3d7b service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Refreshing instance network info cache due to event network-changed-8fe55dd3-70db-4ca5-a666-509aeb6aab2d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1933d075-f457-41a7-8613-6c8b91a550a0 req-71fded20-7a25-4e0f-9bfc-5feea2cb3d7b service nova] Acquiring lock "refresh_cache-682dbab8-ba72-4379-abaf-c35c9fff9d31" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:02:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.network.neutron [req-6a29a513-9e9a-4b7d-b419-8450b0b4721d req-0eea84ff-4dcf-45b9-a397-4a22a8206a44 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updated VIF entry in instance network info cache for port 548341b0-47da-4962-b21a-fd4cc4118bdc. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.network.neutron [req-6a29a513-9e9a-4b7d-b419-8450b0b4721d req-0eea84ff-4dcf-45b9-a397-4a22a8206a44 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6a29a513-9e9a-4b7d-b419-8450b0b4721d req-0eea84ff-4dcf-45b9-a397-4a22a8206a44 service nova] Releasing lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Updating instance_info_cache with network_info: [{"id": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "address": "fa:16:3e:0a:94:95", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe55dd3-70", "ovs_interfaceid": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Releasing lock "refresh_cache-682dbab8-ba72-4379-abaf-c35c9fff9d31" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Instance network_info: |[{"id": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "address": "fa:16:3e:0a:94:95", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe55dd3-70", "ovs_interfaceid": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1933d075-f457-41a7-8613-6c8b91a550a0 req-71fded20-7a25-4e0f-9bfc-5feea2cb3d7b service nova] Acquired lock "refresh_cache-682dbab8-ba72-4379-abaf-c35c9fff9d31" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.network.neutron [req-1933d075-f457-41a7-8613-6c8b91a550a0 req-71fded20-7a25-4e0f-9bfc-5feea2cb3d7b service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Refreshing network info cache for port 8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Start _get_guest_xml network_info=[{"id": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "address": "fa:16:3e:0a:94:95", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe55dd3-70", "ovs_interfaceid": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lazy-loading 'flavor' on Instance uuid 0654db58-a031-4998-bb1e-d4fa7f2a7046 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:16 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:02:16 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1234023889',display_name='tempest-ServersNegativeTestJSON-server-1234023889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1234023889',id=11,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae4b7b47c8c9413d828928c6132eb104',ramdisk_id='',reservation_id='r-6i3zm7m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-764876388',owner_user_name='tempest-ServersNegativeTestJSON-764876388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:02:13Z,user_data=None,user_id='7d24985b850c46e3bdb31296af169a23',uuid=682dbab8-ba72-4379-abaf-c35c9fff9d31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "address": "fa:16:3e:0a:94:95", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe55dd3-70", "ovs_interfaceid": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converting VIF {"id": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "address": "fa:16:3e:0a:94:95", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe55dd3-70", "ovs_interfaceid": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:94:95,bridge_name='br-int',has_traffic_filtering=True,id=8fe55dd3-70db-4ca5-a666-509aeb6aab2d,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe55dd3-70') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lazy-loading 'pci_devices' on Instance uuid 682dbab8-ba72-4379-abaf-c35c9fff9d31 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:02:16 user nova-compute[72000]:   <uuid>682dbab8-ba72-4379-abaf-c35c9fff9d31</uuid>
Aug 16 18:02:16 user nova-compute[72000]:   <name>instance-0000000b</name>
Aug 16 18:02:16 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:02:16 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:02:16 user nova-compute[72000]:   <metadata>
Aug 16 18:02:16 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:02:16 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:02:16 user nova-compute[72000]:       <nova:name>tempest-ServersNegativeTestJSON-server-1234023889</nova:name>
Aug 16 18:02:16 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:02:16</nova:creationTime>
Aug 16 18:02:16 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:02:16 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:02:16 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:02:16 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:02:16 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:02:16 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:02:16 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:02:16 user nova-compute[72000]:       <nova:owner>
Aug 16 18:02:16 user nova-compute[72000]:         <nova:user uuid="7d24985b850c46e3bdb31296af169a23">tempest-ServersNegativeTestJSON-764876388-project-member</nova:user>
Aug 16 18:02:16 user nova-compute[72000]:         <nova:project uuid="ae4b7b47c8c9413d828928c6132eb104">tempest-ServersNegativeTestJSON-764876388</nova:project>
Aug 16 18:02:16 user nova-compute[72000]:       </nova:owner>
Aug 16 18:02:16 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:02:16 user nova-compute[72000]:       <nova:ports>
Aug 16 18:02:16 user nova-compute[72000]:         <nova:port uuid="8fe55dd3-70db-4ca5-a666-509aeb6aab2d">
Aug 16 18:02:16 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:02:16 user nova-compute[72000]:         </nova:port>
Aug 16 18:02:16 user nova-compute[72000]:       </nova:ports>
Aug 16 18:02:16 user nova-compute[72000]:     </nova:instance>
Aug 16 18:02:16 user nova-compute[72000]:   </metadata>
Aug 16 18:02:16 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:02:16 user nova-compute[72000]:     <system>
Aug 16 18:02:16 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:02:16 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:02:16 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:02:16 user nova-compute[72000]:       <entry name="serial">682dbab8-ba72-4379-abaf-c35c9fff9d31</entry>
Aug 16 18:02:16 user nova-compute[72000]:       <entry name="uuid">682dbab8-ba72-4379-abaf-c35c9fff9d31</entry>
Aug 16 18:02:16 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:02:16 user nova-compute[72000]:     </system>
Aug 16 18:02:16 user nova-compute[72000]:   </sysinfo>
Aug 16 18:02:16 user nova-compute[72000]:   <os>
Aug 16 18:02:16 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:02:16 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:02:16 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:02:16 user nova-compute[72000]:   </os>
Aug 16 18:02:16 user nova-compute[72000]:   <features>
Aug 16 18:02:16 user nova-compute[72000]:     <acpi/>
Aug 16 18:02:16 user nova-compute[72000]:     <apic/>
Aug 16 18:02:16 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:02:16 user nova-compute[72000]:   </features>
Aug 16 18:02:16 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:02:16 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:02:16 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:02:16 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:02:16 user nova-compute[72000]:   </clock>
Aug 16 18:02:16 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:02:16 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:02:16 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:02:16 user nova-compute[72000]:   </cpu>
Aug 16 18:02:16 user nova-compute[72000]:   <devices>
Aug 16 18:02:16 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:02:16 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:02:16 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk"/>
Aug 16 18:02:16 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:02:16 user nova-compute[72000]:     </disk>
Aug 16 18:02:16 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:02:16 user nova-compute[72000]:       <mac address="fa:16:3e:0a:94:95"/>
Aug 16 18:02:16 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:02:16 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:02:16 user nova-compute[72000]:       <target dev="tap8fe55dd3-70"/>
Aug 16 18:02:16 user nova-compute[72000]:     </interface>
Aug 16 18:02:16 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:02:16 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/console.log" append="off"/>
Aug 16 18:02:16 user nova-compute[72000]:     </serial>
Aug 16 18:02:16 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:02:16 user nova-compute[72000]:     <video>
Aug 16 18:02:16 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:02:16 user nova-compute[72000]:     </video>
Aug 16 18:02:16 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:02:16 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:02:16 user nova-compute[72000]:     </rng>
Aug 16 18:02:16 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:02:16 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:02:16 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:02:16 user nova-compute[72000]:     </memballoon>
Aug 16 18:02:16 user nova-compute[72000]:   </devices>
Aug 16 18:02:16 user nova-compute[72000]: </domain>
Aug 16 18:02:16 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1234023889',display_name='tempest-ServersNegativeTestJSON-server-1234023889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1234023889',id=11,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae4b7b47c8c9413d828928c6132eb104',ramdisk_id='',reservation_id='r-6i3zm7m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-764876388',owner_user_name='tempest-ServersNegativeTestJSON-764876388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:02:13Z,user_data=None,user_id='7d24985b850c46e3bdb31296af169a23',uuid=682dbab8-ba72-4379-abaf-c35c9fff9d31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "address": "fa:16:3e:0a:94:95", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe55dd3-70", "ovs_interfaceid": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converting VIF {"id": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "address": "fa:16:3e:0a:94:95", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe55dd3-70", "ovs_interfaceid": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:94:95,bridge_name='br-int',has_traffic_filtering=True,id=8fe55dd3-70db-4ca5-a666-509aeb6aab2d,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe55dd3-70') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG os_vif [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:94:95,bridge_name='br-int',has_traffic_filtering=True,id=8fe55dd3-70db-4ca5-a666-509aeb6aab2d,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe55dd3-70') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.182s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fe55dd3-70, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fe55dd3-70, col_values=(('external_ids', {'iface-id': '8fe55dd3-70db-4ca5-a666-509aeb6aab2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:94:95', 'vm-uuid': '682dbab8-ba72-4379-abaf-c35c9fff9d31'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:16 user nova-compute[72000]: INFO os_vif [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:94:95,bridge_name='br-int',has_traffic_filtering=True,id=8fe55dd3-70db-4ca5-a666-509aeb6aab2d,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe55dd3-70')
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] No VIF found with MAC fa:16:3e:0a:94:95, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.network.neutron [req-1933d075-f457-41a7-8613-6c8b91a550a0 req-71fded20-7a25-4e0f-9bfc-5feea2cb3d7b service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Updated VIF entry in instance network info cache for port 8fe55dd3-70db-4ca5-a666-509aeb6aab2d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG nova.network.neutron [req-1933d075-f457-41a7-8613-6c8b91a550a0 req-71fded20-7a25-4e0f-9bfc-5feea2cb3d7b service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Updating instance_info_cache with network_info: [{"id": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "address": "fa:16:3e:0a:94:95", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe55dd3-70", "ovs_interfaceid": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1933d075-f457-41a7-8613-6c8b91a550a0 req-71fded20-7a25-4e0f-9bfc-5feea2cb3d7b service nova] Releasing lock "refresh_cache-682dbab8-ba72-4379-abaf-c35c9fff9d31" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:16 user nova-compute[72000]: INFO nova.compute.manager [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Attaching volume 3302d563-ce64-4103-9cb0-50a9aa3a8d80 to /dev/vdb
Aug 16 18:02:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:17 user nova-compute[72000]: DEBUG os_brick.utils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:17 user nova-compute[72000]: INFO oslo.privsep.daemon [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmps7uw4onv/privsep.sock']
Aug 16 18:02:17 user sudo[83387]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmps7uw4onv/privsep.sock
Aug 16 18:02:17 user sudo[83387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 16 18:02:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-bdcb5f33-0c4c-494f-a6a1-eab7dd4a2fb4 req-6229672e-dd57-4017-8cff-23e80a6dfb7f service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Received event network-vif-plugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bdcb5f33-0c4c-494f-a6a1-eab7dd4a2fb4 req-6229672e-dd57-4017-8cff-23e80a6dfb7f service nova] Acquiring lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bdcb5f33-0c4c-494f-a6a1-eab7dd4a2fb4 req-6229672e-dd57-4017-8cff-23e80a6dfb7f service nova] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bdcb5f33-0c4c-494f-a6a1-eab7dd4a2fb4 req-6229672e-dd57-4017-8cff-23e80a6dfb7f service nova] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-bdcb5f33-0c4c-494f-a6a1-eab7dd4a2fb4 req-6229672e-dd57-4017-8cff-23e80a6dfb7f service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] No waiting events found dispatching network-vif-plugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:02:18 user nova-compute[72000]: WARNING nova.compute.manager [req-bdcb5f33-0c4c-494f-a6a1-eab7dd4a2fb4 req-6229672e-dd57-4017-8cff-23e80a6dfb7f service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Received unexpected event network-vif-plugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d for instance with vm_state building and task_state spawning.
Aug 16 18:02:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:19 user sudo[83387]: pam_unix(sudo:session): session closed for user root
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:19 user nova-compute[72000]: INFO oslo.privsep.daemon [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Spawned new privsep daemon via rootwrap
Aug 16 18:02:19 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 16 18:02:19 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 16 18:02:19 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 16 18:02:19 user nova-compute[72000]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83463
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6575b4-5a38-4ad8-9aa6-c629bdab62c8]: (2,) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0b0549-af47-4ae2-aa5b-51e7da7b7e40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:19 user nova-compute[72000]: WARNING os_brick.initiator.connectors.nvmeof [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd4927c-ad05-4c38-8b49-a05b530f9abe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e16fb-b54a-41c1-8fae-6b5638698ea6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d151381-b9e1-4c72-9420-7bec56a9832b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:19 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[40200779-da75-4d2e-8b5b-8f8240d166e6]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG os_brick.utils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] <== get_connector_properties: return (2498ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Updating existing volume attachment record: 6c1fb7a8-4e22-4188-b92e-b6651877a554 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:20 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:02:20 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=6922MB free_disk=23.948909759521484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-1c5a8916-ee6f-4f1e-bb78-60f45b9f52bf req-498db3e2-692d-4682-9900-52ac54cb14bd service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Received event network-vif-plugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1c5a8916-ee6f-4f1e-bb78-60f45b9f52bf req-498db3e2-692d-4682-9900-52ac54cb14bd service nova] Acquiring lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1c5a8916-ee6f-4f1e-bb78-60f45b9f52bf req-498db3e2-692d-4682-9900-52ac54cb14bd service nova] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1c5a8916-ee6f-4f1e-bb78-60f45b9f52bf req-498db3e2-692d-4682-9900-52ac54cb14bd service nova] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-1c5a8916-ee6f-4f1e-bb78-60f45b9f52bf req-498db3e2-692d-4682-9900-52ac54cb14bd service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] No waiting events found dispatching network-vif-plugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:02:20 user nova-compute[72000]: WARNING nova.compute.manager [req-1c5a8916-ee6f-4f1e-bb78-60f45b9f52bf req-498db3e2-692d-4682-9900-52ac54cb14bd service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Received unexpected event network-vif-plugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d for instance with vm_state building and task_state spawning.
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208940.4680088, 682dbab8-ba72-4379-abaf-c35c9fff9d31 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:02:20 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] VM Resumed (Lifecycle Event)
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:02:20 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Instance spawned successfully.
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:02:20 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692208940.4692209, 682dbab8-ba72-4379-abaf-c35c9fff9d31 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:02:20 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] VM Started (Lifecycle Event)
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 0654db58-a031-4998-bb1e-d4fa7f2a7046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a8532341-62b3-4c58-b3d8-db5440ad08c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 49796cab-9592-4761-8acd-f54c1219ffb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 0e7d8582-d732-4344-9f10-97ef34e8a391 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 24b1035b-ae88-49a1-94f6-edc05ffce52a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 682dbab8-ba72-4379-abaf-c35c9fff9d31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:02:20 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:02:20 user nova-compute[72000]: INFO nova.compute.manager [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Took 7.19 seconds to spawn the instance on the hypervisor.
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:02:20 user nova-compute[72000]: INFO nova.compute.manager [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Took 7.97 seconds to build instance.
Aug 16 18:02:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ef749cdc-2572-4836-85fd-7c4ee1aca8da tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.076s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:02:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-15923127-c9a8-4553-aa0a-1007eaae4774 req-508c27e8-8e61-429f-8da7-682481e0364a service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-changed-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-15923127-c9a8-4553-aa0a-1007eaae4774 req-508c27e8-8e61-429f-8da7-682481e0364a service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Refreshing instance network info cache due to event network-changed-2ac3c99f-65bd-4aaa-899d-41ec43d44906. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:02:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-15923127-c9a8-4553-aa0a-1007eaae4774 req-508c27e8-8e61-429f-8da7-682481e0364a service nova] Acquiring lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-15923127-c9a8-4553-aa0a-1007eaae4774 req-508c27e8-8e61-429f-8da7-682481e0364a service nova] Acquired lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:21 user nova-compute[72000]: DEBUG nova.network.neutron [req-15923127-c9a8-4553-aa0a-1007eaae4774 req-508c27e8-8e61-429f-8da7-682481e0364a service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Refreshing network info cache for port 2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:02:22 user nova-compute[72000]: DEBUG nova.network.neutron [req-15923127-c9a8-4553-aa0a-1007eaae4774 req-508c27e8-8e61-429f-8da7-682481e0364a service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updated VIF entry in instance network info cache for port 2ac3c99f-65bd-4aaa-899d-41ec43d44906. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:02:22 user nova-compute[72000]: DEBUG nova.network.neutron [req-15923127-c9a8-4553-aa0a-1007eaae4774 req-508c27e8-8e61-429f-8da7-682481e0364a service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updating instance_info_cache with network_info: [{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-15923127-c9a8-4553-aa0a-1007eaae4774 req-508c27e8-8e61-429f-8da7-682481e0364a service nova] Releasing lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:25 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:26 user nova-compute[72000]: INFO nova.compute.manager [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Attaching volume 2b319930-55cc-4304-87b2-b1777b2fbe7d to /dev/vdb
Aug 16 18:02:26 user nova-compute[72000]: DEBUG os_brick.utils [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[697810ea-60b5-4f63-968c-de05f5eb19cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2569aa-5513-452b-8ad0-f614a97718f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c692ff-afc7-4dc8-962b-e9618ec4d725]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1efe00f-bfb9-4735-9927-bb86f3d52777]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:26 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:02:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f521ae8-1c68-4ba3-a2bc-0e269c53b39f]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG os_brick.utils [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updating existing volume attachment record: a92da204-e808-4ffd-9bab-7dd26e5e1476 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:02:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connector [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Factory for ISCSI on None {{(pid=72000) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.009s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etOjACNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:31 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:02:31 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:02:31 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:02:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4b6d52-ed91-4859-9a6f-330f7bca7f47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:02:31 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[865e7842-6139-4754-a0a8-7c93dab2943a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80] added
Aug 16 18:02:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a501b79-2609-44df-bfcf-cc379a759865]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[09532858-20a2-4b1e-a77b-58fe0718a3a1]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etOjACNy {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etOjACNy" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe46c49d-bca5-4323-9683-ab78516f404d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etOjACNy'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[682e3023-1e79-44ef-8f74-98b6398d67d3]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90834180-0720-44c8-b931-4519b884cf9f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:02:31 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:02:31 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:02:31 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 18:02:31 user nova-compute[72000]: 
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --login" returned: 0 in 0.161s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0c6988-81e6-482d-ab5e-a99c0d671f88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80, portal: 172.16.0.220,3260]
Aug 16 18:02:31 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80, portal: 172.16.0.220,3260] successful.
Aug 16 18:02:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7319584e-f95c-4ed1-be1e-9c4f72db6ffb]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8f5485-6559-40ad-a442-440e2632e73b]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 (non-flash)
Aug 16 18:02:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 (non-flash)
Aug 16 18:02:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] HCTL ('33', '-', '-', 0) found on session 1 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[419615bd-fe6b-4da8-8e39-d1537badccd0]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:02:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etOjACNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:02:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:02:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23931653863356235', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931653863356235', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:02:32 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lazy-loading 'flavor' on Instance uuid 0654db58-a031-4998-bb1e-d4fa7f2a7046 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:02:32 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:02:32 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:02:32 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:02:32 user nova-compute[72000]:   <serial>3302d563-ce64-4103-9cb0-50a9aa3a8d80</serial>
Aug 16 18:02:32 user nova-compute[72000]: </disk>
Aug 16 18:02:32 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:02:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:02:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:02:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] No VIF found with MAC fa:16:3e:c1:b9:f0, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:02:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c7233a0d-2b15-4cad-ac6c-410153bbe727 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.223s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:34 user nova-compute[72000]: INFO nova.compute.manager [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Terminating instance
Aug 16 18:02:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:02:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:35 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Instance destroyed successfully.
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.objects.instance [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lazy-loading 'resources' on Instance uuid 0654db58-a031-4998-bb1e-d4fa7f2a7046 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-926137146',display_name='tempest-DeleteServersTestJSON-server-926137146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-926137146',id=3,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c736b21ec661426490744efe8f2a112a',ramdisk_id='',reservation_id='r-qkweuiw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1434220361',owner_user_name='tempest-DeleteServersTestJSON-1434220361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:00:41Z,user_data=None,user_id='9d6f2d34629946ba9884b356f1df71e4',uuid=0654db58-a031-4998-bb1e-d4fa7f2a7046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "address": "fa:16:3e:c1:b9:f0", "network": {"id": "e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1659872504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c736b21ec661426490744efe8f2a112a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7a5d1a-9a", "ovs_interfaceid": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Converting VIF {"id": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "address": "fa:16:3e:c1:b9:f0", "network": {"id": "e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1659872504-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c736b21ec661426490744efe8f2a112a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa7a5d1a-9a", "ovs_interfaceid": "fa7a5d1a-9afa-47ba-9be7-34e44f229a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b9:f0,bridge_name='br-int',has_traffic_filtering=True,id=fa7a5d1a-9afa-47ba-9be7-34e44f229a1b,network=Network(e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7a5d1a-9a') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_vif [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b9:f0,bridge_name='br-int',has_traffic_filtering=True,id=fa7a5d1a-9afa-47ba-9be7-34e44f229a1b,network=Network(e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7a5d1a-9a') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa7a5d1a-9a, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:02:35 user nova-compute[72000]: INFO os_vif [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b9:f0,bridge_name='br-int',has_traffic_filtering=True,id=fa7a5d1a-9afa-47ba-9be7-34e44f229a1b,network=Network(e1a678d2-5707-45e8-ac5b-0a2c78cbf4ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa7a5d1a-9a')
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etOjACNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:35 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0942eeec-72e8-42a3-959f-cbf04fd4a6a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fda073-55cf-4286-80a9-c954f8b07424]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 (non-flash)
Aug 16 18:02:35 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 (non-flash)
Aug 16 18:02:35 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01019e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fa9c6-6716-4aaf-8ed1-627b9cdb913d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5c9717-5d79-4b17-9ea6-3812ee520315]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce60ce1-a41a-421b-8be2-8d7bf377dbdd]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1006db02-4f22-461c-813b-24b7991e31b0]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2f2c7e-0627-408e-aa32-1e9c7ace5d0c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-4581883d-44eb-45cd-921c-370ae8d664a8 req-be0af444-2cc6-421a-85f2-bdf06cebd177 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Received event network-vif-unplugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4581883d-44eb-45cd-921c-370ae8d664a8 req-be0af444-2cc6-421a-85f2-bdf06cebd177 service nova] Acquiring lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4581883d-44eb-45cd-921c-370ae8d664a8 req-be0af444-2cc6-421a-85f2-bdf06cebd177 service nova] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4581883d-44eb-45cd-921c-370ae8d664a8 req-be0af444-2cc6-421a-85f2-bdf06cebd177 service nova] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-4581883d-44eb-45cd-921c-370ae8d664a8 req-be0af444-2cc6-421a-85f2-bdf06cebd177 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] No waiting events found dispatching network-vif-unplugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-4581883d-44eb-45cd-921c-370ae8d664a8 req-be0af444-2cc6-421a-85f2-bdf06cebd177 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Received event network-vif-unplugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c10eff-699d-4ea4-99cb-34dbcdae06f6]: (4, ('Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80, portal: 172.16.0.220,3260]\nLogout of [sid: 1, target: iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80, portal: 172.16.0.220,3260]
Aug 16 18:02:35 user nova-compute[72000]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80, portal: 172.16.0.220,3260] successful.
Aug 16 18:02:35 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3302d563-ce64-4103-9cb0-50a9aa3a8d80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[644b8bb4-3bcd-4d00-b6a3-648445d24e0e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] <== disconnect_volume: return (274ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:02:35 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Deleting instance files /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046_del
Aug 16 18:02:35 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Deletion of /opt/stack/data/nova/instances/0654db58-a031-4998-bb1e-d4fa7f2a7046_del complete
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72000) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 16 18:02:35 user nova-compute[72000]: INFO nova.virt.libvirt.host [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] UEFI support detected
Aug 16 18:02:35 user nova-compute[72000]: INFO nova.compute.manager [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 16 18:02:35 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:02:35 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:02:36 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-73686236-3756-4bd9-a3ee-b3612d03f7cd req-3c95687f-81d0-4dd2-86ac-06e7e6c87cf8 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Received event network-vif-deleted-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:36 user nova-compute[72000]: INFO nova.compute.manager [req-73686236-3756-4bd9-a3ee-b3612d03f7cd req-3c95687f-81d0-4dd2-86ac-06e7e6c87cf8 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Neutron deleted interface fa7a5d1a-9afa-47ba-9be7-34e44f229a1b; detaching it from the instance and deleting it from the info cache
Aug 16 18:02:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-73686236-3756-4bd9-a3ee-b3612d03f7cd req-3c95687f-81d0-4dd2-86ac-06e7e6c87cf8 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:36 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Took 0.64 seconds to deallocate network for instance.
Aug 16 18:02:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-73686236-3756-4bd9-a3ee-b3612d03f7cd req-3c95687f-81d0-4dd2-86ac-06e7e6c87cf8 service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Detach interface failed, port_id=fa7a5d1a-9afa-47ba-9be7-34e44f229a1b, reason: Instance 0654db58-a031-4998-bb1e-d4fa7f2a7046 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:02:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Acquiring lock "49796cab-9592-4761-8acd-f54c1219ffb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "49796cab-9592-4761-8acd-f54c1219ffb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:36 user nova-compute[72000]: DEBUG nova.objects.instance [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lazy-loading 'flavor' on Instance uuid 49796cab-9592-4761-8acd-f54c1219ffb9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "49796cab-9592-4761-8acd-f54c1219ffb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Acquiring lock "49796cab-9592-4761-8acd-f54c1219ffb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "49796cab-9592-4761-8acd-f54c1219ffb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:36 user nova-compute[72000]: INFO nova.compute.manager [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Attaching volume 7ea7ef26-c790-4127-ae69-1d4e5d40f84a to /dev/vdb
Aug 16 18:02:37 user nova-compute[72000]: DEBUG os_brick.utils [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e387cca-ef5f-421a-8693-58f6a273ba2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[86608eb8-3081-41f9-8654-d2ecc8fe7c10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a51a99-21be-4d11-ab50-925d01d75fe8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf4ac50-4307-427d-9f15-bae61ea7c2ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:37 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[239e629d-df01-443f-89ae-597795db36f0]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG os_brick.utils [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Updating existing volume attachment record: 29fbe445-618a-4bdd-a73c-bfd582a5e5a4 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:02:37 user nova-compute[72000]: INFO nova.compute.manager [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Took 0.89 seconds to detach 1 volumes for instance.
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Received event network-vif-plugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] Acquiring lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] No waiting events found dispatching network-vif-plugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:02:37 user nova-compute[72000]: WARNING nova.compute.manager [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Received unexpected event network-vif-plugged-fa7a5d1a-9afa-47ba-9be7-34e44f229a1b for instance with vm_state deleted and task_state None.
Aug 16 18:02:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received event network-changed-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Refreshing instance network info cache due to event network-changed-05d4fd2c-6f16-49b4-9ed2-b9451611d094. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] Acquiring lock "refresh_cache-49796cab-9592-4761-8acd-f54c1219ffb9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] Acquired lock "refresh_cache-49796cab-9592-4761-8acd-f54c1219ffb9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG nova.network.neutron [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Refreshing network info cache for port 05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:02:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:37 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Deleted allocations for instance 0654db58-a031-4998-bb1e-d4fa7f2a7046
Aug 16 18:02:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myzoFxvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:38 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:02:38 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:02:38 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03eff53-1c84-44f3-a26f-12c94a36386c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:02:38 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-71fdab05-1097-4a3b-9137-1397febb5ad9 tempest-DeleteServersTestJSON-1434220361 tempest-DeleteServersTestJSON-1434220361-project-member] Lock "0654db58-a031-4998-bb1e-d4fa7f2a7046" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.440s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5869b77-ab80-472f-a9f2-8573359e7049]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d] added
Aug 16 18:02:38 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d183450-1626-4713-992f-713bba078855]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2393e0a2-6f21-48b4-b8e2-675f1de5c57f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v myzoFxvS {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v myzoFxvS" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b259ba57-1aa4-4a88-8459-8cbd36ae3218]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'myzoFxvS'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[491fedf6-2c37-4fe9-9533-c04da9d16fcb]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3802fd8-a783-40c8-918e-1d27b80e421d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:02:38 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:02:38 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:02:38 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 18:02:38 user nova-compute[72000]: 
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[979a9fd7-a2fe-4b5a-ad0f-205a99c0a7b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260]
Aug 16 18:02:38 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260] successful.
Aug 16 18:02:38 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c9ffdc-2e30-45cf-a2ec-fc276c232638]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e58693f-9e0f-4f13-836b-62b7f913047b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:02:38 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:02:38 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[188611e1-e510-4a44-9a0c-5061b4a7d0ff]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myzoFxvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG nova.network.neutron [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Updated VIF entry in instance network info cache for port 05d4fd2c-6f16-49b4-9ed2-b9451611d094. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG nova.network.neutron [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Updating instance_info_cache with network_info: [{"id": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "address": "fa:16:3e:2e:2a:35", "network": {"id": "9a48b52d-ed41-41d0-a5f9-4a51a64b73ac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1097559854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e666887ff3436ab1e0b019f9d7b888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d4fd2c-6f", "ovs_interfaceid": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-28b8a2fe-78b8-4089-b99e-40fce28cac38 req-5ce37e4d-45f2-4c84-9031-f400141dbbda service nova] Releasing lock "refresh_cache-49796cab-9592-4761-8acd-f54c1219ffb9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:02:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26362383133663539', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362383133663539', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:02:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:02:39 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:02:39 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:02:39 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:02:39 user nova-compute[72000]:   <serial>2b319930-55cc-4304-87b2-b1777b2fbe7d</serial>
Aug 16 18:02:39 user nova-compute[72000]: </disk>
Aug 16 18:02:39 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:02:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:02:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:02:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No VIF found with MAC fa:16:3e:e1:0f:ec, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5011fad2-e552-4548-8bf2-92ec5d6a9d83 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.814s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c270bc0a-549c-44da-8bed-27db32a4f58c tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c270bc0a-549c-44da-8bed-27db32a4f58c tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c270bc0a-549c-44da-8bed-27db32a4f58c tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c270bc0a-549c-44da-8bed-27db32a4f58c tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72000) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c270bc0a-549c-44da-8bed-27db32a4f58c tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-1842658e-c298-4153-a61c-9d0682f7564c req-879e9918-6cff-4397-bdae-eff3cd698414 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-unplugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1842658e-c298-4153-a61c-9d0682f7564c req-879e9918-6cff-4397-bdae-eff3cd698414 service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1842658e-c298-4153-a61c-9d0682f7564c req-879e9918-6cff-4397-bdae-eff3cd698414 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1842658e-c298-4153-a61c-9d0682f7564c req-879e9918-6cff-4397-bdae-eff3cd698414 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-1842658e-c298-4153-a61c-9d0682f7564c req-879e9918-6cff-4397-bdae-eff3cd698414 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-unplugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:02:40 user nova-compute[72000]: WARNING nova.compute.manager [req-1842658e-c298-4153-a61c-9d0682f7564c req-879e9918-6cff-4397-bdae-eff3cd698414 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-unplugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state active and task_state powering-off.
Aug 16 18:02:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-f57c9df6-2c06-4e6e-acca-5ff35ee4681b req-af446c38-5a5e-461c-9e41-cb4b5f46afa1 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-changed-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-f57c9df6-2c06-4e6e-acca-5ff35ee4681b req-af446c38-5a5e-461c-9e41-cb4b5f46afa1 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Refreshing instance network info cache due to event network-changed-1bbf38dc-2654-4e85-9dd9-000af10e5c3f. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:02:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f57c9df6-2c06-4e6e-acca-5ff35ee4681b req-af446c38-5a5e-461c-9e41-cb4b5f46afa1 service nova] Acquiring lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f57c9df6-2c06-4e6e-acca-5ff35ee4681b req-af446c38-5a5e-461c-9e41-cb4b5f46afa1 service nova] Acquired lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-f57c9df6-2c06-4e6e-acca-5ff35ee4681b req-af446c38-5a5e-461c-9e41-cb4b5f46afa1 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Refreshing network info cache for port 1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:02:41 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance destroyed successfully.
Aug 16 18:02:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c270bc0a-549c-44da-8bed-27db32a4f58c tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:02:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c270bc0a-549c-44da-8bed-27db32a4f58c tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.935s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-f57c9df6-2c06-4e6e-acca-5ff35ee4681b req-af446c38-5a5e-461c-9e41-cb4b5f46afa1 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Updated VIF entry in instance network info cache for port 1bbf38dc-2654-4e85-9dd9-000af10e5c3f. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:02:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-f57c9df6-2c06-4e6e-acca-5ff35ee4681b req-af446c38-5a5e-461c-9e41-cb4b5f46afa1 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Updating instance_info_cache with network_info: [{"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f57c9df6-2c06-4e6e-acca-5ff35ee4681b req-af446c38-5a5e-461c-9e41-cb4b5f46afa1 service nova] Releasing lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-c7da3448-1cb0-4700-9dc1-edcb004a259a req-ff5af194-668c-41da-a5ac-c9c4a0c10742 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c7da3448-1cb0-4700-9dc1-edcb004a259a req-ff5af194-668c-41da-a5ac-c9c4a0c10742 service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c7da3448-1cb0-4700-9dc1-edcb004a259a req-ff5af194-668c-41da-a5ac-c9c4a0c10742 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c7da3448-1cb0-4700-9dc1-edcb004a259a req-ff5af194-668c-41da-a5ac-c9c4a0c10742 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-c7da3448-1cb0-4700-9dc1-edcb004a259a req-ff5af194-668c-41da-a5ac-c9c4a0c10742 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:02:42 user nova-compute[72000]: WARNING nova.compute.manager [req-c7da3448-1cb0-4700-9dc1-edcb004a259a req-ff5af194-668c-41da-a5ac-c9c4a0c10742 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state stopped and task_state None.
Aug 16 18:02:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-4e29fc45-5dd5-4635-971c-a15ced2bfac4 req-080da540-7e80-45da-a8ba-4894a9024087 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received event network-changed-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-4e29fc45-5dd5-4635-971c-a15ced2bfac4 req-080da540-7e80-45da-a8ba-4894a9024087 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Refreshing instance network info cache due to event network-changed-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:02:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4e29fc45-5dd5-4635-971c-a15ced2bfac4 req-080da540-7e80-45da-a8ba-4894a9024087 service nova] Acquiring lock "refresh_cache-0e7d8582-d732-4344-9f10-97ef34e8a391" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4e29fc45-5dd5-4635-971c-a15ced2bfac4 req-080da540-7e80-45da-a8ba-4894a9024087 service nova] Acquired lock "refresh_cache-0e7d8582-d732-4344-9f10-97ef34e8a391" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:44 user nova-compute[72000]: DEBUG nova.network.neutron [req-4e29fc45-5dd5-4635-971c-a15ced2bfac4 req-080da540-7e80-45da-a8ba-4894a9024087 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Refreshing network info cache for port 5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:02:45 user nova-compute[72000]: DEBUG nova.network.neutron [req-4e29fc45-5dd5-4635-971c-a15ced2bfac4 req-080da540-7e80-45da-a8ba-4894a9024087 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Updated VIF entry in instance network info cache for port 5c59111e-ecfb-4d21-89e2-1f2b5f1c5042. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:02:45 user nova-compute[72000]: DEBUG nova.network.neutron [req-4e29fc45-5dd5-4635-971c-a15ced2bfac4 req-080da540-7e80-45da-a8ba-4894a9024087 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Updating instance_info_cache with network_info: [{"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4e29fc45-5dd5-4635-971c-a15ced2bfac4 req-080da540-7e80-45da-a8ba-4894a9024087 service nova] Releasing lock "refresh_cache-0e7d8582-d732-4344-9f10-97ef34e8a391" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG nova.objects.instance [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lazy-loading 'flavor' on Instance uuid b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:46 user nova-compute[72000]: INFO nova.compute.manager [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Attaching volume 1f6bdd25-a87a-4064-9d44-0ba1536aeb18 to /dev/vdb
Aug 16 18:02:46 user nova-compute[72000]: DEBUG os_brick.utils [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5d657a-8903-44b4-b0be-6b1aa3939b8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39121f0-ba04-479d-9da1-72f05d680625]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f6ae9b-24b8-4a72-b5e3-01c12b5c52fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[88379c9f-0eac-44ce-88c3-7010e2ed8027]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:46 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:02:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[377ac97a-edbd-4065-9cc6-8970d298c378]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG os_brick.utils [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:46 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Updating existing volume attachment record: b37ef17a-bc64-49af-b9a1-930624f16f6c {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:02:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAYhnJZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:48 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:02:48 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:02:48 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72eaa9b-b5de-4efc-9fae-39468821a4cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:02:48 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b305e1f7-d08c-4973-a1f6-2473eae0ab96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a] added
Aug 16 18:02:48 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80d73d1-e3b7-4cca-bb56-86962dbfa48e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cff140-5af8-46fc-8759-babc8a454a6d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAYhnJZC {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAYhnJZC" returned: 0 in 0.038s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a24e99-27c7-4cd5-bc4d-ce37b323817c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UAYhnJZC'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b6c98f-3c7b-4e39-bed9-51a921162eec]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3cf40d-98ba-498a-8c0a-614cfc6c5ca8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:02:48 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:02:48 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae4624a-5cb1-47ad-8cbf-a2fe48258857]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a, portal: 172.16.0.220,3260]
Aug 16 18:02:48 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a, portal: 172.16.0.220,3260] successful.
Aug 16 18:02:48 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16bf1bb-8a31-4010-ba56-c55e8598e771]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b4555f-1ca5-41d2-94fc-cb96f99cb113]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:02:48 user nova-compute[72000]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a (non-flash)
Aug 16 18:02:48 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:02:48 user nova-compute[72000]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a (non-flash)
Aug 16 18:02:48 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG nova.compute.manager [req-f0b2f0cc-04c4-4181-b79a-6808256c204a req-700ada50-0674-4be9-8ffc-a4dbbb5686db service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-changed-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG nova.compute.manager [req-f0b2f0cc-04c4-4181-b79a-6808256c204a req-700ada50-0674-4be9-8ffc-a4dbbb5686db service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Refreshing instance network info cache due to event network-changed-1a9af2dc-bef9-4a0f-993d-1b61022dda5d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f0b2f0cc-04c4-4181-b79a-6808256c204a req-700ada50-0674-4be9-8ffc-a4dbbb5686db service nova] Acquiring lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f0b2f0cc-04c4-4181-b79a-6808256c204a req-700ada50-0674-4be9-8ffc-a4dbbb5686db service nova] Acquired lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG nova.network.neutron [req-f0b2f0cc-04c4-4181-b79a-6808256c204a req-700ada50-0674-4be9-8ffc-a4dbbb5686db service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Refreshing network info cache for port 1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2174d7-8eba-4f35-9744-45097e710b97]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:02:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAYhnJZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG nova.network.neutron [req-f0b2f0cc-04c4-4181-b79a-6808256c204a req-700ada50-0674-4be9-8ffc-a4dbbb5686db service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updated VIF entry in instance network info cache for port 1a9af2dc-bef9-4a0f-993d-1b61022dda5d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG nova.network.neutron [req-f0b2f0cc-04c4-4181-b79a-6808256c204a req-700ada50-0674-4be9-8ffc-a4dbbb5686db service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updating instance_info_cache with network_info: [{"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f0b2f0cc-04c4-4181-b79a-6808256c204a req-700ada50-0674-4be9-8ffc-a4dbbb5686db service nova] Releasing lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "interface-24b1035b-ae88-49a1-94f6-edc05ffce52a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "interface-24b1035b-ae88-49a1-94f6-edc05ffce52a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG nova.objects.instance [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lazy-loading 'flavor' on Instance uuid 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG nova.objects.instance [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lazy-loading 'pci_requests' on Instance uuid 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG nova.network.neutron [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "0e7d8582-d732-4344-9f10-97ef34e8a391" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG nova.objects.instance [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lazy-loading 'flavor' on Instance uuid 0e7d8582-d732-4344-9f10-97ef34e8a391 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG nova.policy [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fce8ded340af4611b075dbf018443714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '675f746e18c248c7a817617bf6a08e0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23663313432613930', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663313432613930', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG nova.objects.instance [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lazy-loading 'flavor' on Instance uuid 49796cab-9592-4761-8acd-f54c1219ffb9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] attach device xml: <disk type="block" device="disk">
Aug 16 18:02:49 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:02:49 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:02:49 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:02:49 user nova-compute[72000]:   <serial>7ea7ef26-c790-4127-ae69-1d4e5d40f84a</serial>
Aug 16 18:02:49 user nova-compute[72000]: </disk>
Aug 16 18:02:49 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "0e7d8582-d732-4344-9f10-97ef34e8a391" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:49 user nova-compute[72000]: INFO nova.compute.manager [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Attaching volume b60725c5-90f7-448c-808e-d7f882143200 to /dev/sdc
Aug 16 18:02:50 user nova-compute[72000]: DEBUG os_brick.utils [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69eab02-2f7d-40f2-89e0-f16ff14de6a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0c8c69-ad48-4df2-bf22-3f04d6e8fc96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f3b23-ee64-4aff-a48f-adf832d4bc3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[153a38bb-99fb-4b27-971c-1c3609324f4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:50 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb290873-5fc4-4f96-830d-726f1b3a1bf2]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG os_brick.utils [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Updating existing volume attachment record: 9476050a-46d8-4ab3-9c2f-aa36e4995fd9 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] No VIF found with MAC fa:16:3e:2e:2a:35, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Successfully created port: a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692208955.4688048, 0654db58-a031-4998-bb1e-d4fa7f2a7046 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:02:50 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] VM Stopped (Lifecycle Event)
Aug 16 18:02:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9e0568c3-7b3d-4db7-a45b-dda5d9489846 None None] [instance: 0654db58-a031-4998-bb1e-d4fa7f2a7046] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d9a4694d-ccfb-401c-999a-0fe1657c7b85 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "49796cab-9592-4761-8acd-f54c1219ffb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.562s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-62c6672e-5a20-4c58-8a64-52ed50809345 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] volume_snapshot_create: create_info: {'snapshot_id': '95e1e56f-280f-40ae-8376-c6f98e31426b', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72000) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-62c6672e-5a20-4c58-8a64-52ed50809345 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] snap xml: <domainsnapshot>
Aug 16 18:02:51 user nova-compute[72000]:   <disks>
Aug 16 18:02:51 user nova-compute[72000]:     <disk name="/dev/sdc" snapshot="external" type="file">
Aug 16 18:02:51 user nova-compute[72000]:       <source file="/dev/new_file"/>
Aug 16 18:02:51 user nova-compute[72000]:     </disk>
Aug 16 18:02:51 user nova-compute[72000]:     <disk name="vda" snapshot="no"/>
Aug 16 18:02:51 user nova-compute[72000]:   </disks>
Aug 16 18:02:51 user nova-compute[72000]: </domainsnapshot>
Aug 16 18:02:51 user nova-compute[72000]:  {{(pid=72000) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.objects.instance [None req-62c6672e-5a20-4c58-8a64-52ed50809345 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lazy-loading 'system_metadata' on Instance uuid 49796cab-9592-4761-8acd-f54c1219ffb9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101febb4-8bbf-4352-8ad6-df0472d92391 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] volume_snapshot_delete: delete_info: {'volume_id': '7ea7ef26-c790-4127-ae69-1d4e5d40f84a'} {{(pid=72000) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [None req-101febb4-8bbf-4352-8ad6-df0472d92391 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     if delete_info['type'] != 'qcow2':
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] KeyError: 'type'
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] 
Aug 16 18:02:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-62c6672e-5a20-4c58-8a64-52ed50809345 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [None req-62c6672e-5a20-4c58-8a64-52ed50809345 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     rv = execute(f, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     six.reraise(c, e, tb)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     raise value
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     rv = meth(*args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [None req-62c6672e-5a20-4c58-8a64-52ed50809345 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     self._volume_snapshot_create(context, instance, guest,
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     rv = execute(f, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     six.reraise(c, e, tb)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     raise value
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     rv = meth(*args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [None req-101febb4-8bbf-4352-8ad6-df0472d92391 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-4c34b24e-13c3-4df5-83e9-6564d72933cb)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver 
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server [None req-101febb4-8bbf-4352-8ad6-df0472d92391 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Exception during message handling: KeyError: 'type'
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver [None req-62c6672e-5a20-4c58-8a64-52ed50809345 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 95e1e56f-280f-40ae-8376-c6f98e31426b could not be found.
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     raise value
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 95e1e56f-280f-40ae-8376-c6f98e31426b could not be found. (HTTP 404) (Request-ID: req-b3d7c862-40d4-4fd6-bb87-bba160f93188)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver 
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 95e1e56f-280f-40ae-8376-c6f98e31426b could not be found.
Aug 16 18:02:51 user nova-compute[72000]: ERROR nova.virt.libvirt.driver 
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server [None req-62c6672e-5a20-4c58-8a64-52ed50809345 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise value
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 16 18:02:51 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:02:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Acquiring lock "49796cab-9592-4761-8acd-f54c1219ffb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "49796cab-9592-4761-8acd-f54c1219ffb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:51 user nova-compute[72000]: INFO nova.compute.manager [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Detaching volume 7ea7ef26-c790-4127-ae69-1d4e5d40f84a
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Successfully updated port: a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquired lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:02:51 user nova-compute[72000]: INFO nova.virt.block_device [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Attempting to driver detach volume 7ea7ef26-c790-4127-ae69-1d4e5d40f84a from mountpoint /dev/vdb
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-9652434d-23b6-4100-b1ec-e65f672f7927 req-0162ecbf-4ab0-471c-b812-e688cf287369 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-changed-a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-9652434d-23b6-4100-b1ec-e65f672f7927 req-0162ecbf-4ab0-471c-b812-e688cf287369 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Refreshing instance network info cache due to event network-changed-a8b153c0-727a-4d72-959b-93a317a0ecb4. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9652434d-23b6-4100-b1ec-e65f672f7927 req-0162ecbf-4ab0-471c-b812-e688cf287369 service nova] Acquiring lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Attempting to detach device vdb from instance 49796cab-9592-4761-8acd-f54c1219ffb9 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 18:02:51 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:02:51 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:02:51 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:02:51 user nova-compute[72000]:   <serial>7ea7ef26-c790-4127-ae69-1d4e5d40f84a</serial>
Aug 16 18:02:51 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:02:51 user nova-compute[72000]: </disk>
Aug 16 18:02:51 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:02:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Successfully detached device vdb from instance 49796cab-9592-4761-8acd-f54c1219ffb9 from the persistent domain config.
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49796cab-9592-4761-8acd-f54c1219ffb9 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:02:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] detach device xml: <disk type="block" device="disk">
Aug 16 18:02:51 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:02:51 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:02:51 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:02:51 user nova-compute[72000]:   <serial>7ea7ef26-c790-4127-ae69-1d4e5d40f84a</serial>
Aug 16 18:02:51 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:02:51 user nova-compute[72000]: </disk>
Aug 16 18:02:51 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692208972.048735, 49796cab-9592-4761-8acd-f54c1219ffb9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49796cab-9592-4761-8acd-f54c1219ffb9 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:02:52 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Successfully detached device vdb from instance 49796cab-9592-4761-8acd-f54c1219ffb9 from the live domain config.
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAYhnJZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:52 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[306b4ae2-9abb-43ab-8f74-efe4967fe669]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf48f9e-340f-4c9d-8c94-4bdc4ad2678e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:02:52 user nova-compute[72000]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a (non-flash)
Aug 16 18:02:52 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:02:52 user nova-compute[72000]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a (non-flash)
Aug 16 18:02:52 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0084f30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[591fbe9a-ee2f-41df-b30f-654e6691a095]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-d2c90704-e306-4b7b-92f9-90d329db099a req-71b688d4-1b47-4609-92a9-8bdde56390d8 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received event network-changed-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-d2c90704-e306-4b7b-92f9-90d329db099a req-71b688d4-1b47-4609-92a9-8bdde56390d8 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Refreshing instance network info cache due to event network-changed-0c92204c-43a6-4966-8a04-b04fdc1b1b3a. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d2c90704-e306-4b7b-92f9-90d329db099a req-71b688d4-1b47-4609-92a9-8bdde56390d8 service nova] Acquiring lock "refresh_cache-cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d2c90704-e306-4b7b-92f9-90d329db099a req-71b688d4-1b47-4609-92a9-8bdde56390d8 service nova] Acquired lock "refresh_cache-cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-d2c90704-e306-4b7b-92f9-90d329db099a req-71b688d4-1b47-4609-92a9-8bdde56390d8 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Refreshing network info cache for port 0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e28cc0-eaa8-4525-84da-eccbee695f54]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6ed136-756b-4dec-9591-513861bcbfce]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.network.neutron [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updating instance_info_cache with network_info: [{"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "address": "fa:16:3e:e5:3f:01", "network": {"id": "0a6ab212-187d-4a04-8258-0e23b2bbc3c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2001398865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b153c0-72", "ovs_interfaceid": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Releasing lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9652434d-23b6-4100-b1ec-e65f672f7927 req-0162ecbf-4ab0-471c-b812-e688cf287369 service nova] Acquired lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-9652434d-23b6-4100-b1ec-e65f672f7927 req-0162ecbf-4ab0-471c-b812-e688cf287369 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Refreshing network info cache for port a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71010681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71010681',id=9,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBItXYqUoCpbqB6nSOayr8Vmqi37fPWCEeevSnocKUkNBleJi6mxX7ey3iNWYzB6KMn1zWiw2auNdGp5nEMlxZXHrlq22uXueVa1zdbdPsbcd4KjbcH3ueYvIsSHmeZYEw==',key_name='tempest-keypair-1147753708',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='675f746e18c248c7a817617bf6a08e0e',ramdisk_id='',reservation_id='r-ae811ic6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487068983',owner_user_name='tempest-TaggedAttachmentsTest-1487068983-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce8ded340af4611b075dbf018443714',uuid=24b1035b-ae88-49a1-94f6-edc05ffce52a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "address": "fa:16:3e:e5:3f:01", "network": {"id": "0a6ab212-187d-4a04-8258-0e23b2bbc3c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2001398865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b153c0-72", "ovs_interfaceid": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converting VIF {"id": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "address": "fa:16:3e:e5:3f:01", "network": {"id": "0a6ab212-187d-4a04-8258-0e23b2bbc3c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2001398865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b153c0-72", "ovs_interfaceid": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3f:01,bridge_name='br-int',has_traffic_filtering=True,id=a8b153c0-727a-4d72-959b-93a317a0ecb4,network=Network(0a6ab212-187d-4a04-8258-0e23b2bbc3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b153c0-72') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_vif [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3f:01,bridge_name='br-int',has_traffic_filtering=True,id=a8b153c0-727a-4d72-959b-93a317a0ecb4,network=Network(0a6ab212-187d-4a04-8258-0e23b2bbc3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b153c0-72') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fab2e48-3bf8-4db4-b902-27d77f761ed7]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8b153c0-72, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8b153c0-72, col_values=(('external_ids', {'iface-id': 'a8b153c0-727a-4d72-959b-93a317a0ecb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:3f:01', 'vm-uuid': '24b1035b-ae88-49a1-94f6-edc05ffce52a'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:52 user nova-compute[72000]: INFO os_vif [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3f:01,bridge_name='br-int',has_traffic_filtering=True,id=a8b153c0-727a-4d72-959b-93a317a0ecb4,network=Network(0a6ab212-187d-4a04-8258-0e23b2bbc3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b153c0-72')
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71010681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71010681',id=9,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBItXYqUoCpbqB6nSOayr8Vmqi37fPWCEeevSnocKUkNBleJi6mxX7ey3iNWYzB6KMn1zWiw2auNdGp5nEMlxZXHrlq22uXueVa1zdbdPsbcd4KjbcH3ueYvIsSHmeZYEw==',key_name='tempest-keypair-1147753708',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='675f746e18c248c7a817617bf6a08e0e',ramdisk_id='',reservation_id='r-ae811ic6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487068983',owner_user_name='tempest-TaggedAttachmentsTest-1487068983-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce8ded340af4611b075dbf018443714',uuid=24b1035b-ae88-49a1-94f6-edc05ffce52a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "address": "fa:16:3e:e5:3f:01", "network": {"id": "0a6ab212-187d-4a04-8258-0e23b2bbc3c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2001398865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b153c0-72", "ovs_interfaceid": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converting VIF {"id": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "address": "fa:16:3e:e5:3f:01", "network": {"id": "0a6ab212-187d-4a04-8258-0e23b2bbc3c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2001398865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b153c0-72", "ovs_interfaceid": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3f:01,bridge_name='br-int',has_traffic_filtering=True,id=a8b153c0-727a-4d72-959b-93a317a0ecb4,network=Network(0a6ab212-187d-4a04-8258-0e23b2bbc3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b153c0-72') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cee6e28-6151-4f39-b771-d3c310a17217]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] attach device xml: <interface type="ethernet">
Aug 16 18:02:52 user nova-compute[72000]:   <mac address="fa:16:3e:e5:3f:01"/>
Aug 16 18:02:52 user nova-compute[72000]:   <model type="virtio"/>
Aug 16 18:02:52 user nova-compute[72000]:   <mtu size="1442"/>
Aug 16 18:02:52 user nova-compute[72000]:   <target dev="tapa8b153c0-72"/>
Aug 16 18:02:52 user nova-compute[72000]: </interface>
Aug 16 18:02:52 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[926cc544-24ea-4444-aff7-91e3edd47b89]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a, portal: 172.16.0.220,3260]
Aug 16 18:02:52 user nova-compute[72000]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a, portal: 172.16.0.220,3260] successful.
Aug 16 18:02:52 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ea7ef26-c790-4127-ae69-1d4e5d40f84a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f216cc67-cc5a-4441-abc9-d4f9df62342c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] <== disconnect_volume: return (390ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.objects.instance [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lazy-loading 'flavor' on Instance uuid cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] No BDM found with device name hda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] No VIF found with MAC fa:16:3e:c1:f8:fb, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-d2c90704-e306-4b7b-92f9-90d329db099a req-71b688d4-1b47-4609-92a9-8bdde56390d8 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Updated VIF entry in instance network info cache for port 0c92204c-43a6-4966-8a04-b04fdc1b1b3a. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-d2c90704-e306-4b7b-92f9-90d329db099a req-71b688d4-1b47-4609-92a9-8bdde56390d8 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Updating instance_info_cache with network_info: [{"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:02:52 user nova-compute[72000]:   <nova:package version="0.0.0"/>
Aug 16 18:02:52 user nova-compute[72000]:   <nova:name>tempest-device-tagging-server-71010681</nova:name>
Aug 16 18:02:52 user nova-compute[72000]:   <nova:creationTime>2023-08-16 18:02:52</nova:creationTime>
Aug 16 18:02:52 user nova-compute[72000]:   <nova:flavor name="m1.tiny">
Aug 16 18:02:52 user nova-compute[72000]:     <nova:memory>512</nova:memory>
Aug 16 18:02:52 user nova-compute[72000]:     <nova:disk>1</nova:disk>
Aug 16 18:02:52 user nova-compute[72000]:     <nova:swap>0</nova:swap>
Aug 16 18:02:52 user nova-compute[72000]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:02:52 user nova-compute[72000]:     <nova:vcpus>1</nova:vcpus>
Aug 16 18:02:52 user nova-compute[72000]:   </nova:flavor>
Aug 16 18:02:52 user nova-compute[72000]:   <nova:owner>
Aug 16 18:02:52 user nova-compute[72000]:     <nova:user uuid="fce8ded340af4611b075dbf018443714">tempest-TaggedAttachmentsTest-1487068983-project-member</nova:user>
Aug 16 18:02:52 user nova-compute[72000]:     <nova:project uuid="675f746e18c248c7a817617bf6a08e0e">tempest-TaggedAttachmentsTest-1487068983</nova:project>
Aug 16 18:02:52 user nova-compute[72000]:   </nova:owner>
Aug 16 18:02:52 user nova-compute[72000]:   <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:02:52 user nova-compute[72000]:   <nova:ports>
Aug 16 18:02:52 user nova-compute[72000]:     <nova:port uuid="1a9af2dc-bef9-4a0f-993d-1b61022dda5d">
Aug 16 18:02:52 user nova-compute[72000]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 18:02:52 user nova-compute[72000]:     </nova:port>
Aug 16 18:02:52 user nova-compute[72000]:     <nova:port uuid="a8b153c0-727a-4d72-959b-93a317a0ecb4">
Aug 16 18:02:52 user nova-compute[72000]:       <nova:ip type="fixed" address="10.10.10.218" ipVersion="4"/>
Aug 16 18:02:52 user nova-compute[72000]:     </nova:port>
Aug 16 18:02:52 user nova-compute[72000]:   </nova:ports>
Aug 16 18:02:52 user nova-compute[72000]: </nova:instance>
Aug 16 18:02:52 user nova-compute[72000]:  {{(pid=72000) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d2c90704-e306-4b7b-92f9-90d329db099a req-71b688d4-1b47-4609-92a9-8bdde56390d8 service nova] Releasing lock "refresh_cache-cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-006fda78-e0c5-49f3-83f2-d0d3184fd3f1 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "interface-24b1035b-ae88-49a1-94f6-edc05ffce52a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.435s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG nova.network.neutron [req-9652434d-23b6-4100-b1ec-e65f672f7927 req-0162ecbf-4ab0-471c-b812-e688cf287369 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updated VIF entry in instance network info cache for port a8b153c0-727a-4d72-959b-93a317a0ecb4. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG nova.network.neutron [req-9652434d-23b6-4100-b1ec-e65f672f7927 req-0162ecbf-4ab0-471c-b812-e688cf287369 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updating instance_info_cache with network_info: [{"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "address": "fa:16:3e:e5:3f:01", "network": {"id": "0a6ab212-187d-4a04-8258-0e23b2bbc3c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2001398865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b153c0-72", "ovs_interfaceid": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9652434d-23b6-4100-b1ec-e65f672f7927 req-0162ecbf-4ab0-471c-b812-e688cf287369 service nova] Releasing lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lazy-loading 'flavor' on Instance uuid 49796cab-9592-4761-8acd-f54c1219ffb9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5968497-8a25-4804-b6a5-ab378432d6f3 tempest-VolumesAssistedSnapshotsTest-714955585 tempest-VolumesAssistedSnapshotsTest-714955585-project-admin] Lock "49796cab-9592-4761-8acd-f54c1219ffb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.950s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-plugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] No waiting events found dispatching network-vif-plugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:02:53 user nova-compute[72000]: WARNING nova.compute.manager [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received unexpected event network-vif-plugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 for instance with vm_state active and task_state None.
Aug 16 18:02:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-plugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] No waiting events found dispatching network-vif-plugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:02:53 user nova-compute[72000]: WARNING nova.compute.manager [req-a6de43c8-f98e-4e12-b42c-e2b0df466603 req-0546ed18-2c19-4366-8340-38eec3905031 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received unexpected event network-vif-plugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 for instance with vm_state active and task_state None.
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lazy-loading 'flavor' on Instance uuid 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:53 user nova-compute[72000]: INFO nova.compute.manager [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Attaching volume dfd16c1f-5c8c-4508-a0c7-73f9732a3551 to /dev/vdb
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:02:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:02:53 user nova-compute[72000]: INFO nova.compute.manager [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Attaching volume 69c7d169-2a48-402d-8176-302e539f9478 to /dev/vdb
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.utils [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2566fbea-432f-4e7c-ba1d-466464850be5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1915813-525e-44fe-aece-ff3d9d74aa9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.utils [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25dd6ce-b76a-4322-b078-ed55f2f97380]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee97607-94c3-4c14-8487-5773732bca20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[40122e6a-43b9-48ff-948a-b36eb373bc08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d71f069-07b2-4a31-8594-ea6c5350bb82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:54 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[78182ef5-862a-43bb-8b2b-b8a8e2aebbc5]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.utils [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Updating existing volume attachment record: 3504740d-2b62-4c39-a4fb-043dfefcc35f {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1f51d2-5617-464b-8480-3258f51293b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af6ce72-10d5-46e1-b205-c54167e21511]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:02:54 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:02:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[832d009c-c8b7-4db1-86a4-2e2dd2826b72]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG os_brick.utils [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:02:54 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updating existing volume attachment record: ba72d52d-3a82-4729-9e79-b65b8d033cbe {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:02:56 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692208961.3255222, f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:02:56 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] VM Stopped (Lifecycle Event)
Aug 16 18:02:56 user nova-compute[72000]: DEBUG nova.compute.manager [None req-35b6be93-709d-4c8d-bf48-9ce6878302e1 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:02:56 user nova-compute[72000]: DEBUG nova.compute.manager [None req-35b6be93-709d-4c8d-bf48-9ce6878302e1 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:02:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:02:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKVhFdrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:01 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:01 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:01 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaaee26-c889-4d8e-a116-b0333881b455]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:03:01 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[da19770b-d61a-4b3e-8cd1-d8e3cc57cea7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200] added
Aug 16 18:03:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7b2229-d41b-4a24-a7a2-f09905f827d3]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb817f69-c7e5-46f0-8f38-f846567b0ac8]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MKVhFdrX {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MKVhFdrX" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60050c7-07c8-4d8b-8137-305a372b1d98]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MKVhFdrX'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84133ddc-156f-48bb-b380-47204d762c36]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fa01c9-ced3-4dd5-b0f2-ba5ce4ff36d8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[06444342-4739-47f6-8213-b144b9658923]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200, portal: 172.16.0.220,3260]
Aug 16 18:03:01 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200, portal: 172.16.0.220,3260] successful.
Aug 16 18:03:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[98391b28-faf2-480c-bb72-e3e8c7b8ae5c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[97198f19-32c0-45c5-9e22-6d500bfbfb7c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:01 user nova-compute[72000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)
Aug 16 18:03:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:01 user nova-compute[72000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)
Aug 16 18:03:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee082fb-024f-4ae8-9fe9-ad15abb427be]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:03:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKVhFdrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:03:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23762343436323336', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762343436323336', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:03:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lazy-loading 'flavor' on Instance uuid 0e7d8582-d732-4344-9f10-97ef34e8a391 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:03:03 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:03 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:03:03 user nova-compute[72000]:   <target dev="sdc" bus="scsi"/>
Aug 16 18:03:03 user nova-compute[72000]:   <serial>b60725c5-90f7-448c-808e-d7f882143200</serial>
Aug 16 18:03:03 user nova-compute[72000]:   <address type="drive" controller="0" unit="2"/>
Aug 16 18:03:03 user nova-compute[72000]: </disk>
Aug 16 18:03:03 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:03:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] No BDM found with device name sda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] No VIF found with MAC fa:16:3e:51:dd:e0, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:03:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwitAbYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:09 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:09 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:09 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[228196c7-5712-42a3-9a3d-216042460e94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:03:09 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8271bd7a-6361-4d33-921f-bfe60821892d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18] added
Aug 16 18:03:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e56f3e-93ae-4325-81a0-b4af67a4c7ca]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5badad1-e506-40d8-bb6f-874e2f8e76e7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwitAbYp {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwitAbYp" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb97f93-59be-45db-b526-ecc4ffe50cab]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VwitAbYp'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0465441d-cd5a-43fc-b434-707517e1fea1]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[022ca6ba-4ecb-42ce-9f69-f84cf5d001ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:09 user nova-compute[72000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)
Aug 16 18:03:09 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:09 user nova-compute[72000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)
Aug 16 18:03:09 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e167c262-c1cc-43a3-b0ae-d4a913a80b52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18, portal: 172.16.0.220,3260]
Aug 16 18:03:09 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18, portal: 172.16.0.220,3260] successful.
Aug 16 18:03:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6901e1d0-a56e-4553-8cfe-28d9aa448adf]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d80a13-98f7-4eb3-9d5f-74610a1afc6c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:09 user nova-compute[72000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)
Aug 16 18:03:09 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:09 user nova-compute[72000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)
Aug 16 18:03:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:09 user nova-compute[72000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)
Aug 16 18:03:09 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:09 user nova-compute[72000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)
Aug 16 18:03:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f581de-61d1-4517-ad7b-ee7c94c1ee1b]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwitAbYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:03:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-06f9c6b3-db11-4b85-a003-19c97499d8af tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.968s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:10 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:10 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23165306135616337', 'path': '/dev/sde'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165306135616337', 'path': '/dev/sde'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:03:10 user nova-compute[72000]: DEBUG nova.objects.instance [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lazy-loading 'flavor' on Instance uuid b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:03:10 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:10 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:03:10 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:03:10 user nova-compute[72000]:   <serial>1f6bdd25-a87a-4064-9d44-0ba1536aeb18</serial>
Aug 16 18:03:10 user nova-compute[72000]: </disk>
Aug 16 18:03:10 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:03:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] No VIF found with MAC fa:16:3e:70:dd:99, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:03:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-293cf534-d632-4a4b-807b-915cea9a6d90 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.953s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "0e7d8582-d732-4344-9f10-97ef34e8a391" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:11 user nova-compute[72000]: INFO nova.compute.manager [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Detaching volume b60725c5-90f7-448c-808e-d7f882143200
Aug 16 18:03:11 user nova-compute[72000]: INFO nova.virt.block_device [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Attempting to driver detach volume b60725c5-90f7-448c-808e-d7f882143200 from mountpoint /dev/sdc
Aug 16 18:03:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Attempting to detach device sdc from instance 0e7d8582-d732-4344-9f10-97ef34e8a391 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:03:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:03:11 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:11 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:03:11 user nova-compute[72000]:   <target dev="sdc" bus="scsi"/>
Aug 16 18:03:11 user nova-compute[72000]:   <serial>b60725c5-90f7-448c-808e-d7f882143200</serial>
Aug 16 18:03:11 user nova-compute[72000]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 18:03:11 user nova-compute[72000]: </disk>
Aug 16 18:03:11 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:03:11 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Successfully detached device sdc from instance 0e7d8582-d732-4344-9f10-97ef34e8a391 from the persistent domain config.
Aug 16 18:03:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 0e7d8582-d732-4344-9f10-97ef34e8a391 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:03:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:03:11 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:11 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:03:11 user nova-compute[72000]:   <target dev="sdc" bus="scsi"/>
Aug 16 18:03:11 user nova-compute[72000]:   <serial>b60725c5-90f7-448c-808e-d7f882143200</serial>
Aug 16 18:03:11 user nova-compute[72000]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 16 18:03:11 user nova-compute[72000]: </disk>
Aug 16 18:03:11 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692208992.1701274, 0e7d8582-d732-4344-9f10-97ef34e8a391 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 0e7d8582-d732-4344-9f10-97ef34e8a391 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:03:12 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Successfully detached device sdc from instance 0e7d8582-d732-4344-9f10-97ef34e8a391 from the live domain config.
Aug 16 18:03:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKVhFdrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:12 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c397c-cf41-43d1-8cb6-527175d665d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a2e2e9-1305-4141-a31c-2a27e2e6bbc9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:12 user nova-compute[72000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)
Aug 16 18:03:12 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:12 user nova-compute[72000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)
Aug 16 18:03:12 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:12 user nova-compute[72000]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 (non-flash)
Aug 16 18:03:12 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:12 user nova-compute[72000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)
Aug 16 18:03:12 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0085ebc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0300fe91-3bad-4d4a-98f8-fe78972a5108]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3341948-e9f5-4239-9b78-9e1bba30e4bb]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c73f5c4-d0a8-4110-8f41-be81dfb9bf01]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[865bc927-a9f6-43c7-8c66-9f67b313b8a8]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bd176b-91c7-4bb1-916e-6073e5cf988f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bb9bfc-f593-4597-b94d-25df11905f4c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200, portal: 172.16.0.220,3260]
Aug 16 18:03:12 user nova-compute[72000]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200, portal: 172.16.0.220,3260] successful.
Aug 16 18:03:12 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b60725c5-90f7-448c-808e-d7f882143200 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6840b51f-56e3-4088-b734-772d9d0e8c26]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] <== disconnect_volume: return (332ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:03:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.objects.instance [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lazy-loading 'flavor' on Instance uuid 0e7d8582-d732-4344-9f10-97ef34e8a391 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:03:14 user nova-compute[72000]: INFO nova.compute.claims [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Claim successful on node user
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:14 user nova-compute[72000]: INFO nova.compute.manager [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Detaching volume 1f6bdd25-a87a-4064-9d44-0ba1536aeb18
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dadd522a-93cc-4cd6-aa81-5999a6142949 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.470s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfDUeTpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:14 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:14 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:14 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: INFO nova.virt.block_device [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Attempting to driver detach volume 1f6bdd25-a87a-4064-9d44-0ba1536aeb18 from mountpoint /dev/vdb
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Attempting to detach device vdb from instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:03:14 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:14 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:03:14 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:03:14 user nova-compute[72000]:   <serial>1f6bdd25-a87a-4064-9d44-0ba1536aeb18</serial>
Aug 16 18:03:14 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:03:14 user nova-compute[72000]: </disk>
Aug 16 18:03:14 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aeea23-efdb-4a06-9661-5008c5ac125a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:03:14 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Successfully detached device vdb from instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 from the persistent domain config.
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:03:14 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:14 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:03:14 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:03:14 user nova-compute[72000]:   <serial>1f6bdd25-a87a-4064-9d44-0ba1536aeb18</serial>
Aug 16 18:03:14 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:03:14 user nova-compute[72000]: </disk>
Aug 16 18:03:14 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4e8a0c-8411-4f48-9e5b-4edad281cefa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478] added
Aug 16 18:03:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce0d069-cdd3-494b-ad59-cccebc7ccbb0]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a0801c-786f-4087-88cf-f86011ed218a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nfDUeTpo {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nfDUeTpo" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1972798-9aac-48ca-84cc-d31d0a4f08d7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nfDUeTpo'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[660dbeab-1ef8-41f7-a194-03926b142763]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb550b8-e6e6-4bb9-a7c7-9eec93c56345]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:14 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:14 user nova-compute[72000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)
Aug 16 18:03:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:14 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:14 user nova-compute[72000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)
Aug 16 18:03:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[819dda61-15a5-4326-a4a9-45d7c9d28ad5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478, portal: 172.16.0.220,3260]
Aug 16 18:03:14 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478, portal: 172.16.0.220,3260] successful.
Aug 16 18:03:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed2b60e-13d2-4f72-90b9-235a151a94b8]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.818s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7f8848-17b5-4612-a3ce-2d52c94d5120]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:14 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:14 user nova-compute[72000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)
Aug 16 18:03:14 user nova-compute[72000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)
Aug 16 18:03:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:14 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:14 user nova-compute[72000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)
Aug 16 18:03:14 user nova-compute[72000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)
Aug 16 18:03:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d841b96-b905-444c-ab2d-8bcf1a492187]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfDUeTpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:03:14 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:03:14 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.policy [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb9c67db30d3443eaf28670635863118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c4769a48b847f994e32e7c01bd39e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:03:15 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Creating image(s)
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "/opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "/opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "/opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692208995.1862297, b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:03:15 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Successfully detached device vdb from instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 from the live domain config.
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwitAbYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:15 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.216s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk 1073741824" returned: 0 in 0.059s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Successfully created port: 0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.198s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26337353432363136', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337353432363136', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.638s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.objects.instance [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lazy-loading 'flavor' on Instance uuid 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccc6421-c7d5-4a06-8a91-7a8307696150]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:03:15 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:15 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:03:15 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:03:15 user nova-compute[72000]:   <serial>69c7d169-2a48-402d-8176-302e539f9478</serial>
Aug 16 18:03:15 user nova-compute[72000]: </disk>
Aug 16 18:03:15 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bd90e1-61cc-46cb-bd90-4d8e7e95cba4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:15 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:15 user nova-compute[72000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)
Aug 16 18:03:15 user nova-compute[72000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)
Aug 16 18:03:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:15 user nova-compute[72000]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:15 user nova-compute[72000]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 (non-flash)
Aug 16 18:03:15 user nova-compute[72000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)
Aug 16 18:03:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0101b1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18'): ({'sde'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Removing single pathed devices sde {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:03:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c4df7e-951a-47d9-b440-2741efcf590f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[54778543-5056-4d1a-9492-4302f05e975d]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Flushing IO for device /dev/sde {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f091d4-cf4d-4a89-86c0-8626f08729d9]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Cannot resize image /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.objects.instance [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'migration_context' on Instance uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Ensure instance console log exists: /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[739a4826-2c99-43e7-8172-b07e9da8ec2e]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[db809d38-486d-4ee6-a290-12f8751632da]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[495c6186-3a50-4450-bc4e-15c05d6c5841]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18, portal: 172.16.0.220,3260]
Aug 16 18:03:16 user nova-compute[72000]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18, portal: 172.16.0.220,3260] successful.
Aug 16 18:03:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f6bdd25-a87a-4064-9d44-0ba1536aeb18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9956458c-65a4-49de-bd6f-3fed3dc0248c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] <== disconnect_volume: return (982ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] No BDM found with device name hda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] No VIF found with MAC fa:16:3e:c1:f8:fb, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e95c29aa-352d-4cfe-b683-e8bc7d163557 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.731s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Successfully updated port: 0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquired lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-3e50575f-3fa3-4521-a8bb-713beaa20738 req-7ff9dfd9-b9e6-4391-ad07-768a37dd47b9 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received event network-changed-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-3e50575f-3fa3-4521-a8bb-713beaa20738 req-7ff9dfd9-b9e6-4391-ad07-768a37dd47b9 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Refreshing instance network info cache due to event network-changed-0f4c186b-25e4-4a47-a54e-d58d0abf66fa. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3e50575f-3fa3-4521-a8bb-713beaa20738 req-7ff9dfd9-b9e6-4391-ad07-768a37dd47b9 service nova] Acquiring lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:03:16 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updating instance_info_cache with network_info: [{"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Releasing lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Instance network_info: |[{"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3e50575f-3fa3-4521-a8bb-713beaa20738 req-7ff9dfd9-b9e6-4391-ad07-768a37dd47b9 service nova] Acquired lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.network.neutron [req-3e50575f-3fa3-4521-a8bb-713beaa20738 req-7ff9dfd9-b9e6-4391-ad07-768a37dd47b9 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Refreshing network info cache for port 0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Start _get_guest_xml network_info=[{"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:03:17 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:03:17 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-291985954',display_name='tempest-tempest.common.compute-instance-291985954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-291985954',id=12,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFUjGaHE7pKkphpIlu+qb5TThvRrvfTMXIg6LvDq93nPXqpmsinbGBzE/z1sLW3pAtQ4HaRizKrUDwqgopKDrCUOR6hQe9eKG4sjH3iE9tGInsfqp0+BxDMbd8d9L+pnQ==',key_name='tempest-keypair-1405337443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-r1k21jr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=cef1b726-614c-4b75-8b44-5bc62f235424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f4c186b-25e4-4a47-a54e-d58d0abf66fa,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4c186b-25') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.objects.instance [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'pci_devices' on Instance uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:03:17 user nova-compute[72000]:   <uuid>cef1b726-614c-4b75-8b44-5bc62f235424</uuid>
Aug 16 18:03:17 user nova-compute[72000]:   <name>instance-0000000c</name>
Aug 16 18:03:17 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:03:17 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:03:17 user nova-compute[72000]:   <metadata>
Aug 16 18:03:17 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:03:17 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:03:17 user nova-compute[72000]:       <nova:name>tempest-tempest.common.compute-instance-291985954</nova:name>
Aug 16 18:03:17 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:03:17</nova:creationTime>
Aug 16 18:03:17 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:03:17 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:03:17 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:03:17 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:03:17 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:03:17 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:03:17 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:03:17 user nova-compute[72000]:       <nova:owner>
Aug 16 18:03:17 user nova-compute[72000]:         <nova:user uuid="fb9c67db30d3443eaf28670635863118">tempest-ServerActionsTestOtherA-1630250690-project-member</nova:user>
Aug 16 18:03:17 user nova-compute[72000]:         <nova:project uuid="72c4769a48b847f994e32e7c01bd39e0">tempest-ServerActionsTestOtherA-1630250690</nova:project>
Aug 16 18:03:17 user nova-compute[72000]:       </nova:owner>
Aug 16 18:03:17 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:03:17 user nova-compute[72000]:       <nova:ports>
Aug 16 18:03:17 user nova-compute[72000]:         <nova:port uuid="0f4c186b-25e4-4a47-a54e-d58d0abf66fa">
Aug 16 18:03:17 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 18:03:17 user nova-compute[72000]:         </nova:port>
Aug 16 18:03:17 user nova-compute[72000]:       </nova:ports>
Aug 16 18:03:17 user nova-compute[72000]:     </nova:instance>
Aug 16 18:03:17 user nova-compute[72000]:   </metadata>
Aug 16 18:03:17 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:03:17 user nova-compute[72000]:     <system>
Aug 16 18:03:17 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:03:17 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:03:17 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:03:17 user nova-compute[72000]:       <entry name="serial">cef1b726-614c-4b75-8b44-5bc62f235424</entry>
Aug 16 18:03:17 user nova-compute[72000]:       <entry name="uuid">cef1b726-614c-4b75-8b44-5bc62f235424</entry>
Aug 16 18:03:17 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:03:17 user nova-compute[72000]:     </system>
Aug 16 18:03:17 user nova-compute[72000]:   </sysinfo>
Aug 16 18:03:17 user nova-compute[72000]:   <os>
Aug 16 18:03:17 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:03:17 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:03:17 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:03:17 user nova-compute[72000]:   </os>
Aug 16 18:03:17 user nova-compute[72000]:   <features>
Aug 16 18:03:17 user nova-compute[72000]:     <acpi/>
Aug 16 18:03:17 user nova-compute[72000]:     <apic/>
Aug 16 18:03:17 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:03:17 user nova-compute[72000]:   </features>
Aug 16 18:03:17 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:03:17 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:03:17 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:03:17 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:03:17 user nova-compute[72000]:   </clock>
Aug 16 18:03:17 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:03:17 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:03:17 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:03:17 user nova-compute[72000]:   </cpu>
Aug 16 18:03:17 user nova-compute[72000]:   <devices>
Aug 16 18:03:17 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:03:17 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:03:17 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk"/>
Aug 16 18:03:17 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:03:17 user nova-compute[72000]:     </disk>
Aug 16 18:03:17 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:03:17 user nova-compute[72000]:       <mac address="fa:16:3e:77:34:1d"/>
Aug 16 18:03:17 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:03:17 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:03:17 user nova-compute[72000]:       <target dev="tap0f4c186b-25"/>
Aug 16 18:03:17 user nova-compute[72000]:     </interface>
Aug 16 18:03:17 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:03:17 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/console.log" append="off"/>
Aug 16 18:03:17 user nova-compute[72000]:     </serial>
Aug 16 18:03:17 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:03:17 user nova-compute[72000]:     <video>
Aug 16 18:03:17 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:03:17 user nova-compute[72000]:     </video>
Aug 16 18:03:17 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:03:17 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:03:17 user nova-compute[72000]:     </rng>
Aug 16 18:03:17 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:03:17 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:03:17 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:03:17 user nova-compute[72000]:     </memballoon>
Aug 16 18:03:17 user nova-compute[72000]:   </devices>
Aug 16 18:03:17 user nova-compute[72000]: </domain>
Aug 16 18:03:17 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-291985954',display_name='tempest-tempest.common.compute-instance-291985954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-291985954',id=12,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFUjGaHE7pKkphpIlu+qb5TThvRrvfTMXIg6LvDq93nPXqpmsinbGBzE/z1sLW3pAtQ4HaRizKrUDwqgopKDrCUOR6hQe9eKG4sjH3iE9tGInsfqp0+BxDMbd8d9L+pnQ==',key_name='tempest-keypair-1405337443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-r1k21jr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=cef1b726-614c-4b75-8b44-5bc62f235424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f4c186b-25e4-4a47-a54e-d58d0abf66fa,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4c186b-25') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG os_vif [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f4c186b-25e4-4a47-a54e-d58d0abf66fa,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4c186b-25') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f4c186b-25, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f4c186b-25, col_values=(('external_ids', {'iface-id': '0f4c186b-25e4-4a47-a54e-d58d0abf66fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:34:1d', 'vm-uuid': 'cef1b726-614c-4b75-8b44-5bc62f235424'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:17 user nova-compute[72000]: INFO os_vif [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f4c186b-25e4-4a47-a54e-d58d0abf66fa,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4c186b-25')
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No VIF found with MAC fa:16:3e:77:34:1d, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.objects.instance [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lazy-loading 'flavor' on Instance uuid b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b52d9ca4-982c-4cee-8f11-3bc2b8ff6c95 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.405s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.network.neutron [req-3e50575f-3fa3-4521-a8bb-713beaa20738 req-7ff9dfd9-b9e6-4391-ad07-768a37dd47b9 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updated VIF entry in instance network info cache for port 0f4c186b-25e4-4a47-a54e-d58d0abf66fa. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG nova.network.neutron [req-3e50575f-3fa3-4521-a8bb-713beaa20738 req-7ff9dfd9-b9e6-4391-ad07-768a37dd47b9 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updating instance_info_cache with network_info: [{"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3e50575f-3fa3-4521-a8bb-713beaa20738 req-7ff9dfd9-b9e6-4391-ad07-768a37dd47b9 service nova] Releasing lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:03:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:18 user nova-compute[72000]: INFO nova.compute.manager [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Detaching volume 69c7d169-2a48-402d-8176-302e539f9478
Aug 16 18:03:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McTugyGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:18 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:18 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:18 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdf3e6c-7190-4143-9981-f0233912a30c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:03:18 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: INFO nova.virt.block_device [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Attempting to driver detach volume 69c7d169-2a48-402d-8176-302e539f9478 from mountpoint /dev/vdb
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d4cb79-704d-4616-971c-b64b8fd9e5e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551] added
Aug 16 18:03:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Attempting to detach device vdb from instance 24b1035b-ae88-49a1-94f6-edc05ffce52a from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:03:18 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:18 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:03:18 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:03:18 user nova-compute[72000]:   <serial>69c7d169-2a48-402d-8176-302e539f9478</serial>
Aug 16 18:03:18 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 18:03:18 user nova-compute[72000]: </disk>
Aug 16 18:03:18 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:03:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Successfully detached device vdb from instance 24b1035b-ae88-49a1-94f6-edc05ffce52a from the persistent domain config.
Aug 16 18:03:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 24b1035b-ae88-49a1-94f6-edc05ffce52a from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:03:18 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:18 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:03:18 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:03:18 user nova-compute[72000]:   <serial>69c7d169-2a48-402d-8176-302e539f9478</serial>
Aug 16 18:03:18 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 18:03:18 user nova-compute[72000]: </disk>
Aug 16 18:03:18 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[658f67ad-3af2-4b25-8ed0-6ace307c4a19]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[712f3f0e-76a7-4a28-8f0e-7a0feb66468b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v McTugyGW {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v McTugyGW" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea412da-d144-47f2-b019-e3b54dfbe9c2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'McTugyGW'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7185d901-b609-4be6-bcc6-f85a556f1f29]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3773a1bc-3161-4c6c-8ddd-16668e8f9532]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:18 user nova-compute[72000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)
Aug 16 18:03:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:18 user nova-compute[72000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)
Aug 16 18:03:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e585ab-ee0c-46a3-9055-b432ae409394]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260]
Aug 16 18:03:18 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260] successful.
Aug 16 18:03:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70c631-9b6b-47e6-a923-603b4b677841]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f51ecbb-4334-42bd-b32c-1f987403629b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:18 user nova-compute[72000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)
Aug 16 18:03:18 user nova-compute[72000]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:03:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:18 user nova-compute[72000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)
Aug 16 18:03:18 user nova-compute[72000]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:03:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7f5cc6-b272-4b01-82c5-3db68c87568c]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McTugyGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692208999.0823643, 24b1035b-ae88-49a1-94f6-edc05ffce52a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-89bc02da-682c-4892-8089-a12a3f366501 req-b0986151-70b1-463a-aeb6-b5468ee0e629 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received event network-vif-plugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-89bc02da-682c-4892-8089-a12a3f366501 req-b0986151-70b1-463a-aeb6-b5468ee0e629 service nova] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-89bc02da-682c-4892-8089-a12a3f366501 req-b0986151-70b1-463a-aeb6-b5468ee0e629 service nova] Lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-89bc02da-682c-4892-8089-a12a3f366501 req-b0986151-70b1-463a-aeb6-b5468ee0e629 service nova] Lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-89bc02da-682c-4892-8089-a12a3f366501 req-b0986151-70b1-463a-aeb6-b5468ee0e629 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] No waiting events found dispatching network-vif-plugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:03:19 user nova-compute[72000]: WARNING nova.compute.manager [req-89bc02da-682c-4892-8089-a12a3f366501 req-b0986151-70b1-463a-aeb6-b5468ee0e629 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received unexpected event network-vif-plugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa for instance with vm_state building and task_state spawning.
Aug 16 18:03:19 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Successfully detached device vdb from instance 24b1035b-ae88-49a1-94f6-edc05ffce52a from the live domain config.
Aug 16 18:03:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfDUeTpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:19 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26564646663653965', 'path': '/dev/sdd'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564646663653965', 'path': '/dev/sdd'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.563s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG nova.objects.instance [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lazy-loading 'flavor' on Instance uuid cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[db931b0b-8664-46e7-9064-13d2d7a94629]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:03:19 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:19 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:03:19 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:03:19 user nova-compute[72000]:   <serial>dfd16c1f-5c8c-4508-a0c7-73f9732a3551</serial>
Aug 16 18:03:19 user nova-compute[72000]: </disk>
Aug 16 18:03:19 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4144f896-4109-4993-b445-aa339e16809c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:19 user nova-compute[72000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)
Aug 16 18:03:19 user nova-compute[72000]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:03:19 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:19 user nova-compute[72000]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 (non-flash)
Aug 16 18:03:19 user nova-compute[72000]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:03:19 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd010156170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4222cd75-d3dc-4433-b1cb-bfeff8f94b9b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[05316963-cc87-42d9-9232-a8e11f67d752]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3def2f20-9c7c-4c0a-bb72-69bc6411deac]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[18226ec4-ce2b-4ce1-8816-c5c30df76eb2]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36dc0e6-1894-41eb-9803-0742808e3fdf]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b17113-2dc6-458a-a698-b1b33dc173d7]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478, portal: 172.16.0.220,3260]
Aug 16 18:03:19 user nova-compute[72000]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478, portal: 172.16.0.220,3260] successful.
Aug 16 18:03:19 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69c7d169-2a48-402d-8176-302e539f9478 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[92de553a-2021-430b-b33b-577ad594c6ab]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] <== disconnect_volume: return (833ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:03:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] No VIF found with MAC fa:16:3e:aa:05:61, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:03:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-920deaf8-e90d-4d2e-899c-84b91f4b5011 tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.435s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:20 user nova-compute[72000]: DEBUG nova.objects.instance [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lazy-loading 'flavor' on Instance uuid 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-65cc8c80-df59-4399-9c6e-017317f61bbc tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.592s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:03:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:03:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-3a2c29c6-bfe0-4743-bd19-485d6f56f7a4 req-44c46d70-bb34-4591-974b-0d12730edae4 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received event network-vif-plugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3a2c29c6-bfe0-4743-bd19-485d6f56f7a4 req-44c46d70-bb34-4591-974b-0d12730edae4 service nova] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3a2c29c6-bfe0-4743-bd19-485d6f56f7a4 req-44c46d70-bb34-4591-974b-0d12730edae4 service nova] Lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3a2c29c6-bfe0-4743-bd19-485d6f56f7a4 req-44c46d70-bb34-4591-974b-0d12730edae4 service nova] Lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-3a2c29c6-bfe0-4743-bd19-485d6f56f7a4 req-44c46d70-bb34-4591-974b-0d12730edae4 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] No waiting events found dispatching network-vif-plugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:03:21 user nova-compute[72000]: WARNING nova.compute.manager [req-3a2c29c6-bfe0-4743-bd19-485d6f56f7a4 req-44c46d70-bb34-4591-974b-0d12730edae4 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received unexpected event network-vif-plugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa for instance with vm_state building and task_state spawning.
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG os_brick.utils [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[22efe369-3672-4920-9892-53fb737fc376]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7ee507-1e96-419d-9652-850551c14330]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f3000e-e50d-488d-a640-14a0f8ec1651]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9408ca89-b5d6-463a-88ad-2946585fe89c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209001.3198671, cef1b726-614c-4b75-8b44-5bc62f235424 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:03:21 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] VM Resumed (Lifecycle Event)
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:03:21 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[714e765f-0067-4b3f-81b0-4e80ec52c4e8]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG os_brick.utils [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:03:21 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Instance spawned successfully.
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:03:21 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209001.3201132, cef1b726-614c-4b75-8b44-5bc62f235424 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:03:21 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] VM Started (Lifecycle Event)
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:03:21 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:03:21 user nova-compute[72000]: INFO nova.compute.manager [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Swapping volume dfd16c1f-5c8c-4508-a0c7-73f9732a3551 for 324cf733-db4e-4589-9939-768be84be047
Aug 16 18:03:21 user nova-compute[72000]: INFO nova.compute.manager [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:03:21 user nova-compute[72000]: INFO nova.compute.manager [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Took 8.06 seconds to build instance.
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccf1f78-2d10-40f2-9088-3a0ec76940aa tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.445s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "interface-24b1035b-ae88-49a1-94f6-edc05ffce52a-a8b153c0-727a-4d72-959b-93a317a0ecb4" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "interface-24b1035b-ae88-49a1-94f6-edc05ffce52a-a8b153c0-727a-4d72-959b-93a317a0ecb4" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lazy-loading 'flavor' on Instance uuid 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71010681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71010681',id=9,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBItXYqUoCpbqB6nSOayr8Vmqi37fPWCEeevSnocKUkNBleJi6mxX7ey3iNWYzB6KMn1zWiw2auNdGp5nEMlxZXHrlq22uXueVa1zdbdPsbcd4KjbcH3ueYvIsSHmeZYEw==',key_name='tempest-keypair-1147753708',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='675f746e18c248c7a817617bf6a08e0e',ramdisk_id='',reservation_id='r-ae811ic6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487068983',owner_user_name='tempest-TaggedAttachmentsTest-1487068983-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce8ded340af4611b075dbf018443714',uuid=24b1035b-ae88-49a1-94f6-edc05ffce52a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "address": "fa:16:3e:e5:3f:01", "network": {"id": "0a6ab212-187d-4a04-8258-0e23b2bbc3c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2001398865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b153c0-72", "ovs_interfaceid": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converting VIF {"id": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "address": "fa:16:3e:e5:3f:01", "network": {"id": "0a6ab212-187d-4a04-8258-0e23b2bbc3c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2001398865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b153c0-72", "ovs_interfaceid": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3f:01,bridge_name='br-int',has_traffic_filtering=True,id=a8b153c0-727a-4d72-959b-93a317a0ecb4,network=Network(0a6ab212-187d-4a04-8258-0e23b2bbc3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b153c0-72') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:3f:01"/><model type="virtio"/><mtu size="1442"/><target dev="tapa8b153c0-72"/></interface> {{(pid=72000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:3f:01"/><model type="virtio"/><mtu size="1442"/><target dev="tapa8b153c0-72"/></interface> {{(pid=72000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Attempting to detach device tapa8b153c0-72 from instance 24b1035b-ae88-49a1-94f6-edc05ffce52a from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] detach device xml: <interface type="ethernet">
Aug 16 18:03:21 user nova-compute[72000]:   <mac address="fa:16:3e:e5:3f:01"/>
Aug 16 18:03:21 user nova-compute[72000]:   <model type="virtio"/>
Aug 16 18:03:21 user nova-compute[72000]:   <mtu size="1442"/>
Aug 16 18:03:21 user nova-compute[72000]:   <target dev="tapa8b153c0-72"/>
Aug 16 18:03:21 user nova-compute[72000]: </interface>
Aug 16 18:03:21 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:3f:01"/><model type="virtio"/><mtu size="1442"/><target dev="tapa8b153c0-72"/></interface> {{(pid=72000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:3f:01"/><model type="virtio"/><mtu size="1442"/><target dev="tapa8b153c0-72"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 16 18:03:21 user nova-compute[72000]:   <name>instance-00000009</name>
Aug 16 18:03:21 user nova-compute[72000]:   <uuid>24b1035b-ae88-49a1-94f6-edc05ffce52a</uuid>
Aug 16 18:03:21 user nova-compute[72000]:   <metadata>
Aug 16 18:03:21 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:03:21 user nova-compute[72000]:   <nova:package version="0.0.0"/>
Aug 16 18:03:21 user nova-compute[72000]:   <nova:name>tempest-device-tagging-server-71010681</nova:name>
Aug 16 18:03:21 user nova-compute[72000]:   <nova:creationTime>2023-08-16 18:02:52</nova:creationTime>
Aug 16 18:03:21 user nova-compute[72000]:   <nova:flavor name="m1.tiny">
Aug 16 18:03:21 user nova-compute[72000]:     <nova:memory>512</nova:memory>
Aug 16 18:03:21 user nova-compute[72000]:     <nova:disk>1</nova:disk>
Aug 16 18:03:21 user nova-compute[72000]:     <nova:swap>0</nova:swap>
Aug 16 18:03:21 user nova-compute[72000]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:03:21 user nova-compute[72000]:     <nova:vcpus>1</nova:vcpus>
Aug 16 18:03:21 user nova-compute[72000]:   </nova:flavor>
Aug 16 18:03:21 user nova-compute[72000]:   <nova:owner>
Aug 16 18:03:21 user nova-compute[72000]:     <nova:user uuid="fce8ded340af4611b075dbf018443714">tempest-TaggedAttachmentsTest-1487068983-project-member</nova:user>
Aug 16 18:03:21 user nova-compute[72000]:     <nova:project uuid="675f746e18c248c7a817617bf6a08e0e">tempest-TaggedAttachmentsTest-1487068983</nova:project>
Aug 16 18:03:21 user nova-compute[72000]:   </nova:owner>
Aug 16 18:03:21 user nova-compute[72000]:   <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:03:21 user nova-compute[72000]:   <nova:ports>
Aug 16 18:03:21 user nova-compute[72000]:     <nova:port uuid="1a9af2dc-bef9-4a0f-993d-1b61022dda5d">
Aug 16 18:03:21 user nova-compute[72000]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 18:03:21 user nova-compute[72000]:     </nova:port>
Aug 16 18:03:21 user nova-compute[72000]:     <nova:port uuid="a8b153c0-727a-4d72-959b-93a317a0ecb4">
Aug 16 18:03:21 user nova-compute[72000]:       <nova:ip type="fixed" address="10.10.10.218" ipVersion="4"/>
Aug 16 18:03:21 user nova-compute[72000]:     </nova:port>
Aug 16 18:03:21 user nova-compute[72000]:   </nova:ports>
Aug 16 18:03:21 user nova-compute[72000]: </nova:instance>
Aug 16 18:03:21 user nova-compute[72000]:   </metadata>
Aug 16 18:03:21 user nova-compute[72000]:   <memory unit='KiB'>524288</memory>
Aug 16 18:03:21 user nova-compute[72000]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 18:03:21 user nova-compute[72000]:   <vcpu placement='static'>1</vcpu>
Aug 16 18:03:21 user nova-compute[72000]:   <resource>
Aug 16 18:03:21 user nova-compute[72000]:     <partition>/machine</partition>
Aug 16 18:03:21 user nova-compute[72000]:   </resource>
Aug 16 18:03:21 user nova-compute[72000]:   <sysinfo type='smbios'>
Aug 16 18:03:21 user nova-compute[72000]:     <system>
Aug 16 18:03:21 user nova-compute[72000]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 18:03:21 user nova-compute[72000]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 18:03:21 user nova-compute[72000]:       <entry name='version'>0.0.0</entry>
Aug 16 18:03:21 user nova-compute[72000]:       <entry name='serial'>24b1035b-ae88-49a1-94f6-edc05ffce52a</entry>
Aug 16 18:03:21 user nova-compute[72000]:       <entry name='uuid'>24b1035b-ae88-49a1-94f6-edc05ffce52a</entry>
Aug 16 18:03:21 user nova-compute[72000]:       <entry name='family'>Virtual Machine</entry>
Aug 16 18:03:21 user nova-compute[72000]:     </system>
Aug 16 18:03:21 user nova-compute[72000]:   </sysinfo>
Aug 16 18:03:21 user nova-compute[72000]:   <os>
Aug 16 18:03:21 user nova-compute[72000]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 18:03:21 user nova-compute[72000]:     <boot dev='hd'/>
Aug 16 18:03:21 user nova-compute[72000]:     <smbios mode='sysinfo'/>
Aug 16 18:03:21 user nova-compute[72000]:   </os>
Aug 16 18:03:21 user nova-compute[72000]:   <features>
Aug 16 18:03:21 user nova-compute[72000]:     <acpi/>
Aug 16 18:03:21 user nova-compute[72000]:     <apic/>
Aug 16 18:03:21 user nova-compute[72000]:     <vmcoreinfo state='on'/>
Aug 16 18:03:21 user nova-compute[72000]:   </features>
Aug 16 18:03:21 user nova-compute[72000]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 18:03:21 user nova-compute[72000]:     <model fallback='forbid'>Nehalem</model>
Aug 16 18:03:21 user nova-compute[72000]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 18:03:21 user nova-compute[72000]:     <feature policy='require' name='vme'/>
Aug 16 18:03:21 user nova-compute[72000]:     <feature policy='require' name='x2apic'/>
Aug 16 18:03:21 user nova-compute[72000]:     <feature policy='require' name='hypervisor'/>
Aug 16 18:03:21 user nova-compute[72000]:   </cpu>
Aug 16 18:03:21 user nova-compute[72000]:   <clock offset='utc'>
Aug 16 18:03:21 user nova-compute[72000]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 18:03:21 user nova-compute[72000]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 18:03:21 user nova-compute[72000]:     <timer name='hpet' present='no'/>
Aug 16 18:03:21 user nova-compute[72000]:   </clock>
Aug 16 18:03:21 user nova-compute[72000]:   <on_poweroff>destroy</on_poweroff>
Aug 16 18:03:21 user nova-compute[72000]:   <on_reboot>restart</on_reboot>
Aug 16 18:03:21 user nova-compute[72000]:   <on_crash>destroy</on_crash>
Aug 16 18:03:21 user nova-compute[72000]:   <devices>
Aug 16 18:03:21 user nova-compute[72000]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 18:03:21 user nova-compute[72000]:     <disk type='file' device='disk'>
Aug 16 18:03:21 user nova-compute[72000]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 18:03:21 user nova-compute[72000]:       <source file='/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk' index='2'/>
Aug 16 18:03:21 user nova-compute[72000]:       <backingStore type='file' index='3'>
Aug 16 18:03:21 user nova-compute[72000]:         <format type='raw'/>
Aug 16 18:03:21 user nova-compute[72000]:         <source file='/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56'/>
Aug 16 18:03:21 user nova-compute[72000]:         <backingStore/>
Aug 16 18:03:21 user nova-compute[72000]:       </backingStore>
Aug 16 18:03:21 user nova-compute[72000]:       <target dev='vda' bus='virtio'/>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='virtio-disk0'/>
Aug 16 18:03:21 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </disk>
Aug 16 18:03:21 user nova-compute[72000]:     <disk type='file' device='cdrom'>
Aug 16 18:03:21 user nova-compute[72000]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 18:03:21 user nova-compute[72000]:       <source file='/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk.config' index='1'/>
Aug 16 18:03:21 user nova-compute[72000]:       <backingStore/>
Aug 16 18:03:21 user nova-compute[72000]:       <target dev='hda' bus='ide'/>
Aug 16 18:03:21 user nova-compute[72000]:       <readonly/>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='ide0-0-0'/>
Aug 16 18:03:21 user nova-compute[72000]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </disk>
Aug 16 18:03:21 user nova-compute[72000]:     <controller type='usb' index='0' model='none'>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='usb'/>
Aug 16 18:03:21 user nova-compute[72000]:     </controller>
Aug 16 18:03:21 user nova-compute[72000]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='pci.0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </controller>
Aug 16 18:03:21 user nova-compute[72000]:     <controller type='ide' index='0'>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='ide'/>
Aug 16 18:03:21 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 18:03:21 user nova-compute[72000]:     </controller>
Aug 16 18:03:21 user nova-compute[72000]:     <interface type='ethernet'>
Aug 16 18:03:21 user nova-compute[72000]:       <mac address='fa:16:3e:c1:f8:fb'/>
Aug 16 18:03:21 user nova-compute[72000]:       <target dev='tap1a9af2dc-be'/>
Aug 16 18:03:21 user nova-compute[72000]:       <model type='virtio'/>
Aug 16 18:03:21 user nova-compute[72000]:       <mtu size='1442'/>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='net0'/>
Aug 16 18:03:21 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </interface>
Aug 16 18:03:21 user nova-compute[72000]:     <interface type='ethernet'>
Aug 16 18:03:21 user nova-compute[72000]:       <mac address='fa:16:3e:e5:3f:01'/>
Aug 16 18:03:21 user nova-compute[72000]:       <target dev='tapa8b153c0-72'/>
Aug 16 18:03:21 user nova-compute[72000]:       <model type='virtio'/>
Aug 16 18:03:21 user nova-compute[72000]:       <mtu size='1442'/>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='net1'/>
Aug 16 18:03:21 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </interface>
Aug 16 18:03:21 user nova-compute[72000]:     <serial type='pty'>
Aug 16 18:03:21 user nova-compute[72000]:       <source path='/dev/pts/8'/>
Aug 16 18:03:21 user nova-compute[72000]:       <log file='/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/console.log' append='off'/>
Aug 16 18:03:21 user nova-compute[72000]:       <target type='isa-serial' port='0'>
Aug 16 18:03:21 user nova-compute[72000]:         <model name='isa-serial'/>
Aug 16 18:03:21 user nova-compute[72000]:       </target>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='serial0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </serial>
Aug 16 18:03:21 user nova-compute[72000]:     <console type='pty' tty='/dev/pts/8'>
Aug 16 18:03:21 user nova-compute[72000]:       <source path='/dev/pts/8'/>
Aug 16 18:03:21 user nova-compute[72000]:       <log file='/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/console.log' append='off'/>
Aug 16 18:03:21 user nova-compute[72000]:       <target type='serial' port='0'/>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='serial0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </console>
Aug 16 18:03:21 user nova-compute[72000]:     <input type='mouse' bus='ps2'>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='input0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </input>
Aug 16 18:03:21 user nova-compute[72000]:     <input type='keyboard' bus='ps2'>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='input1'/>
Aug 16 18:03:21 user nova-compute[72000]:     </input>
Aug 16 18:03:21 user nova-compute[72000]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 16 18:03:21 user nova-compute[72000]:       <listen type='address' address='0.0.0.0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </graphics>
Aug 16 18:03:21 user nova-compute[72000]:     <audio id='1' type='none'/>
Aug 16 18:03:21 user nova-compute[72000]:     <video>
Aug 16 18:03:21 user nova-compute[72000]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='video0'/>
Aug 16 18:03:21 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </video>
Aug 16 18:03:21 user nova-compute[72000]:     <memballoon model='virtio'>
Aug 16 18:03:21 user nova-compute[72000]:       <stats period='10'/>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='balloon0'/>
Aug 16 18:03:21 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </memballoon>
Aug 16 18:03:21 user nova-compute[72000]:     <rng model='virtio'>
Aug 16 18:03:21 user nova-compute[72000]:       <backend model='random'>/dev/urandom</backend>
Aug 16 18:03:21 user nova-compute[72000]:       <alias name='rng0'/>
Aug 16 18:03:21 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 18:03:21 user nova-compute[72000]:     </rng>
Aug 16 18:03:21 user nova-compute[72000]:   </devices>
Aug 16 18:03:21 user nova-compute[72000]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 18:03:21 user nova-compute[72000]:     <label>libvirt-24b1035b-ae88-49a1-94f6-edc05ffce52a</label>
Aug 16 18:03:21 user nova-compute[72000]:     <imagelabel>libvirt-24b1035b-ae88-49a1-94f6-edc05ffce52a</imagelabel>
Aug 16 18:03:21 user nova-compute[72000]:   </seclabel>
Aug 16 18:03:21 user nova-compute[72000]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 18:03:21 user nova-compute[72000]:     <label>+64055:+108</label>
Aug 16 18:03:21 user nova-compute[72000]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 18:03:21 user nova-compute[72000]:   </seclabel>
Aug 16 18:03:21 user nova-compute[72000]: </domain>
Aug 16 18:03:21 user nova-compute[72000]:  {{(pid=72000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 18:03:21 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Successfully detached device tapa8b153c0-72 from instance 24b1035b-ae88-49a1-94f6-edc05ffce52a from the persistent domain config.
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] (1/8): Attempting to detach device tapa8b153c0-72 with device alias net1 from instance 24b1035b-ae88-49a1-94f6-edc05ffce52a from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] detach device xml: <interface type="ethernet">
Aug 16 18:03:21 user nova-compute[72000]:   <mac address="fa:16:3e:e5:3f:01"/>
Aug 16 18:03:21 user nova-compute[72000]:   <model type="virtio"/>
Aug 16 18:03:21 user nova-compute[72000]:   <mtu size="1442"/>
Aug 16 18:03:21 user nova-compute[72000]:   <target dev="tapa8b153c0-72"/>
Aug 16 18:03:21 user nova-compute[72000]: </interface>
Aug 16 18:03:21 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:03:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Start waiting for the detach event from libvirt for device tapa8b153c0-72 with device alias net1 for instance 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209002.0866296, 24b1035b-ae88-49a1-94f6-edc05ffce52a => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:3f:01"/><model type="virtio"/><mtu size="1442"/><target dev="tapa8b153c0-72"/></interface> {{(pid=72000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:3f:01"/><model type="virtio"/><mtu size="1442"/><target dev="tapa8b153c0-72"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 16 18:03:22 user nova-compute[72000]:   <name>instance-00000009</name>
Aug 16 18:03:22 user nova-compute[72000]:   <uuid>24b1035b-ae88-49a1-94f6-edc05ffce52a</uuid>
Aug 16 18:03:22 user nova-compute[72000]:   <metadata>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:03:22 user nova-compute[72000]:   <nova:package version="0.0.0"/>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:name>tempest-device-tagging-server-71010681</nova:name>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:creationTime>2023-08-16 18:02:52</nova:creationTime>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:flavor name="m1.tiny">
Aug 16 18:03:22 user nova-compute[72000]:     <nova:memory>512</nova:memory>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:disk>1</nova:disk>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:swap>0</nova:swap>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:vcpus>1</nova:vcpus>
Aug 16 18:03:22 user nova-compute[72000]:   </nova:flavor>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:owner>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:user uuid="fce8ded340af4611b075dbf018443714">tempest-TaggedAttachmentsTest-1487068983-project-member</nova:user>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:project uuid="675f746e18c248c7a817617bf6a08e0e">tempest-TaggedAttachmentsTest-1487068983</nova:project>
Aug 16 18:03:22 user nova-compute[72000]:   </nova:owner>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:ports>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:port uuid="1a9af2dc-bef9-4a0f-993d-1b61022dda5d">
Aug 16 18:03:22 user nova-compute[72000]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 18:03:22 user nova-compute[72000]:     </nova:port>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:port uuid="a8b153c0-727a-4d72-959b-93a317a0ecb4">
Aug 16 18:03:22 user nova-compute[72000]:       <nova:ip type="fixed" address="10.10.10.218" ipVersion="4"/>
Aug 16 18:03:22 user nova-compute[72000]:     </nova:port>
Aug 16 18:03:22 user nova-compute[72000]:   </nova:ports>
Aug 16 18:03:22 user nova-compute[72000]: </nova:instance>
Aug 16 18:03:22 user nova-compute[72000]:   </metadata>
Aug 16 18:03:22 user nova-compute[72000]:   <memory unit='KiB'>524288</memory>
Aug 16 18:03:22 user nova-compute[72000]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 16 18:03:22 user nova-compute[72000]:   <vcpu placement='static'>1</vcpu>
Aug 16 18:03:22 user nova-compute[72000]:   <resource>
Aug 16 18:03:22 user nova-compute[72000]:     <partition>/machine</partition>
Aug 16 18:03:22 user nova-compute[72000]:   </resource>
Aug 16 18:03:22 user nova-compute[72000]:   <sysinfo type='smbios'>
Aug 16 18:03:22 user nova-compute[72000]:     <system>
Aug 16 18:03:22 user nova-compute[72000]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 16 18:03:22 user nova-compute[72000]:       <entry name='product'>OpenStack Nova</entry>
Aug 16 18:03:22 user nova-compute[72000]:       <entry name='version'>0.0.0</entry>
Aug 16 18:03:22 user nova-compute[72000]:       <entry name='serial'>24b1035b-ae88-49a1-94f6-edc05ffce52a</entry>
Aug 16 18:03:22 user nova-compute[72000]:       <entry name='uuid'>24b1035b-ae88-49a1-94f6-edc05ffce52a</entry>
Aug 16 18:03:22 user nova-compute[72000]:       <entry name='family'>Virtual Machine</entry>
Aug 16 18:03:22 user nova-compute[72000]:     </system>
Aug 16 18:03:22 user nova-compute[72000]:   </sysinfo>
Aug 16 18:03:22 user nova-compute[72000]:   <os>
Aug 16 18:03:22 user nova-compute[72000]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 16 18:03:22 user nova-compute[72000]:     <boot dev='hd'/>
Aug 16 18:03:22 user nova-compute[72000]:     <smbios mode='sysinfo'/>
Aug 16 18:03:22 user nova-compute[72000]:   </os>
Aug 16 18:03:22 user nova-compute[72000]:   <features>
Aug 16 18:03:22 user nova-compute[72000]:     <acpi/>
Aug 16 18:03:22 user nova-compute[72000]:     <apic/>
Aug 16 18:03:22 user nova-compute[72000]:     <vmcoreinfo state='on'/>
Aug 16 18:03:22 user nova-compute[72000]:   </features>
Aug 16 18:03:22 user nova-compute[72000]:   <cpu mode='custom' match='exact' check='full'>
Aug 16 18:03:22 user nova-compute[72000]:     <model fallback='forbid'>Nehalem</model>
Aug 16 18:03:22 user nova-compute[72000]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 16 18:03:22 user nova-compute[72000]:     <feature policy='require' name='vme'/>
Aug 16 18:03:22 user nova-compute[72000]:     <feature policy='require' name='x2apic'/>
Aug 16 18:03:22 user nova-compute[72000]:     <feature policy='require' name='hypervisor'/>
Aug 16 18:03:22 user nova-compute[72000]:   </cpu>
Aug 16 18:03:22 user nova-compute[72000]:   <clock offset='utc'>
Aug 16 18:03:22 user nova-compute[72000]:     <timer name='pit' tickpolicy='delay'/>
Aug 16 18:03:22 user nova-compute[72000]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 16 18:03:22 user nova-compute[72000]:     <timer name='hpet' present='no'/>
Aug 16 18:03:22 user nova-compute[72000]:   </clock>
Aug 16 18:03:22 user nova-compute[72000]:   <on_poweroff>destroy</on_poweroff>
Aug 16 18:03:22 user nova-compute[72000]:   <on_reboot>restart</on_reboot>
Aug 16 18:03:22 user nova-compute[72000]:   <on_crash>destroy</on_crash>
Aug 16 18:03:22 user nova-compute[72000]:   <devices>
Aug 16 18:03:22 user nova-compute[72000]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 16 18:03:22 user nova-compute[72000]:     <disk type='file' device='disk'>
Aug 16 18:03:22 user nova-compute[72000]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 16 18:03:22 user nova-compute[72000]:       <source file='/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk' index='2'/>
Aug 16 18:03:22 user nova-compute[72000]:       <backingStore type='file' index='3'>
Aug 16 18:03:22 user nova-compute[72000]:         <format type='raw'/>
Aug 16 18:03:22 user nova-compute[72000]:         <source file='/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56'/>
Aug 16 18:03:22 user nova-compute[72000]:         <backingStore/>
Aug 16 18:03:22 user nova-compute[72000]:       </backingStore>
Aug 16 18:03:22 user nova-compute[72000]:       <target dev='vda' bus='virtio'/>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='virtio-disk0'/>
Aug 16 18:03:22 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </disk>
Aug 16 18:03:22 user nova-compute[72000]:     <disk type='file' device='cdrom'>
Aug 16 18:03:22 user nova-compute[72000]:       <driver name='qemu' type='raw' cache='none'/>
Aug 16 18:03:22 user nova-compute[72000]:       <source file='/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk.config' index='1'/>
Aug 16 18:03:22 user nova-compute[72000]:       <backingStore/>
Aug 16 18:03:22 user nova-compute[72000]:       <target dev='hda' bus='ide'/>
Aug 16 18:03:22 user nova-compute[72000]:       <readonly/>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='ide0-0-0'/>
Aug 16 18:03:22 user nova-compute[72000]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </disk>
Aug 16 18:03:22 user nova-compute[72000]:     <controller type='usb' index='0' model='none'>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='usb'/>
Aug 16 18:03:22 user nova-compute[72000]:     </controller>
Aug 16 18:03:22 user nova-compute[72000]:     <controller type='pci' index='0' model='pci-root'>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='pci.0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </controller>
Aug 16 18:03:22 user nova-compute[72000]:     <controller type='ide' index='0'>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='ide'/>
Aug 16 18:03:22 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 16 18:03:22 user nova-compute[72000]:     </controller>
Aug 16 18:03:22 user nova-compute[72000]:     <interface type='ethernet'>
Aug 16 18:03:22 user nova-compute[72000]:       <mac address='fa:16:3e:c1:f8:fb'/>
Aug 16 18:03:22 user nova-compute[72000]:       <target dev='tap1a9af2dc-be'/>
Aug 16 18:03:22 user nova-compute[72000]:       <model type='virtio'/>
Aug 16 18:03:22 user nova-compute[72000]:       <mtu size='1442'/>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='net0'/>
Aug 16 18:03:22 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </interface>
Aug 16 18:03:22 user nova-compute[72000]:     <serial type='pty'>
Aug 16 18:03:22 user nova-compute[72000]:       <source path='/dev/pts/8'/>
Aug 16 18:03:22 user nova-compute[72000]:       <log file='/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/console.log' append='off'/>
Aug 16 18:03:22 user nova-compute[72000]:       <target type='isa-serial' port='0'>
Aug 16 18:03:22 user nova-compute[72000]:         <model name='isa-serial'/>
Aug 16 18:03:22 user nova-compute[72000]:       </target>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='serial0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </serial>
Aug 16 18:03:22 user nova-compute[72000]:     <console type='pty' tty='/dev/pts/8'>
Aug 16 18:03:22 user nova-compute[72000]:       <source path='/dev/pts/8'/>
Aug 16 18:03:22 user nova-compute[72000]:       <log file='/opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/console.log' append='off'/>
Aug 16 18:03:22 user nova-compute[72000]:       <target type='serial' port='0'/>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='serial0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </console>
Aug 16 18:03:22 user nova-compute[72000]:     <input type='mouse' bus='ps2'>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='input0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </input>
Aug 16 18:03:22 user nova-compute[72000]:     <input type='keyboard' bus='ps2'>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='input1'/>
Aug 16 18:03:22 user nova-compute[72000]:     </input>
Aug 16 18:03:22 user nova-compute[72000]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 16 18:03:22 user nova-compute[72000]:       <listen type='address' address='0.0.0.0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </graphics>
Aug 16 18:03:22 user nova-compute[72000]:     <audio id='1' type='none'/>
Aug 16 18:03:22 user nova-compute[72000]:     <video>
Aug 16 18:03:22 user nova-compute[72000]:       <model type='virtio' heads='1' primary='yes'/>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='video0'/>
Aug 16 18:03:22 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </video>
Aug 16 18:03:22 user nova-compute[72000]:     <memballoon model='virtio'>
Aug 16 18:03:22 user nova-compute[72000]:       <stats period='10'/>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='balloon0'/>
Aug 16 18:03:22 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </memballoon>
Aug 16 18:03:22 user nova-compute[72000]:     <rng model='virtio'>
Aug 16 18:03:22 user nova-compute[72000]:       <backend model='random'>/dev/urandom</backend>
Aug 16 18:03:22 user nova-compute[72000]:       <alias name='rng0'/>
Aug 16 18:03:22 user nova-compute[72000]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 16 18:03:22 user nova-compute[72000]:     </rng>
Aug 16 18:03:22 user nova-compute[72000]:   </devices>
Aug 16 18:03:22 user nova-compute[72000]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 16 18:03:22 user nova-compute[72000]:     <label>libvirt-24b1035b-ae88-49a1-94f6-edc05ffce52a</label>
Aug 16 18:03:22 user nova-compute[72000]:     <imagelabel>libvirt-24b1035b-ae88-49a1-94f6-edc05ffce52a</imagelabel>
Aug 16 18:03:22 user nova-compute[72000]:   </seclabel>
Aug 16 18:03:22 user nova-compute[72000]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 16 18:03:22 user nova-compute[72000]:     <label>+64055:+108</label>
Aug 16 18:03:22 user nova-compute[72000]:     <imagelabel>+64055:+108</imagelabel>
Aug 16 18:03:22 user nova-compute[72000]:   </seclabel>
Aug 16 18:03:22 user nova-compute[72000]: </domain>
Aug 16 18:03:22 user nova-compute[72000]:  {{(pid=72000) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 16 18:03:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Successfully detached device tapa8b153c0-72 from instance 24b1035b-ae88-49a1-94f6-edc05ffce52a from the live domain config.
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71010681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71010681',id=9,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBItXYqUoCpbqB6nSOayr8Vmqi37fPWCEeevSnocKUkNBleJi6mxX7ey3iNWYzB6KMn1zWiw2auNdGp5nEMlxZXHrlq22uXueVa1zdbdPsbcd4KjbcH3ueYvIsSHmeZYEw==',key_name='tempest-keypair-1147753708',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='675f746e18c248c7a817617bf6a08e0e',ramdisk_id='',reservation_id='r-ae811ic6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487068983',owner_user_name='tempest-TaggedAttachmentsTest-1487068983-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce8ded340af4611b075dbf018443714',uuid=24b1035b-ae88-49a1-94f6-edc05ffce52a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "address": "fa:16:3e:e5:3f:01", "network": {"id": "0a6ab212-187d-4a04-8258-0e23b2bbc3c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2001398865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b153c0-72", "ovs_interfaceid": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converting VIF {"id": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "address": "fa:16:3e:e5:3f:01", "network": {"id": "0a6ab212-187d-4a04-8258-0e23b2bbc3c2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2001398865", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8b153c0-72", "ovs_interfaceid": "a8b153c0-727a-4d72-959b-93a317a0ecb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3f:01,bridge_name='br-int',has_traffic_filtering=True,id=a8b153c0-727a-4d72-959b-93a317a0ecb4,network=Network(0a6ab212-187d-4a04-8258-0e23b2bbc3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b153c0-72') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG os_vif [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3f:01,bridge_name='br-int',has_traffic_filtering=True,id=a8b153c0-727a-4d72-959b-93a317a0ecb4,network=Network(0a6ab212-187d-4a04-8258-0e23b2bbc3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b153c0-72') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8b153c0-72, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:22 user nova-compute[72000]: INFO os_vif [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:3f:01,bridge_name='br-int',has_traffic_filtering=True,id=a8b153c0-727a-4d72-959b-93a317a0ecb4,network=Network(0a6ab212-187d-4a04-8258-0e23b2bbc3c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8b153c0-72')
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:03:22 user nova-compute[72000]:   <nova:package version="0.0.0"/>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:name>tempest-device-tagging-server-71010681</nova:name>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:creationTime>2023-08-16 18:03:22</nova:creationTime>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:flavor name="m1.tiny">
Aug 16 18:03:22 user nova-compute[72000]:     <nova:memory>512</nova:memory>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:disk>1</nova:disk>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:swap>0</nova:swap>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:vcpus>1</nova:vcpus>
Aug 16 18:03:22 user nova-compute[72000]:   </nova:flavor>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:owner>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:user uuid="fce8ded340af4611b075dbf018443714">tempest-TaggedAttachmentsTest-1487068983-project-member</nova:user>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:project uuid="675f746e18c248c7a817617bf6a08e0e">tempest-TaggedAttachmentsTest-1487068983</nova:project>
Aug 16 18:03:22 user nova-compute[72000]:   </nova:owner>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:03:22 user nova-compute[72000]:   <nova:ports>
Aug 16 18:03:22 user nova-compute[72000]:     <nova:port uuid="1a9af2dc-bef9-4a0f-993d-1b61022dda5d">
Aug 16 18:03:22 user nova-compute[72000]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 18:03:22 user nova-compute[72000]:     </nova:port>
Aug 16 18:03:22 user nova-compute[72000]:   </nova:ports>
Aug 16 18:03:22 user nova-compute[72000]: </nova:instance>
Aug 16 18:03:22 user nova-compute[72000]:  {{(pid=72000) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-f074f61b-b3b9-4a77-b8d9-c5a988cea53a req-aa94f6ad-d00f-410d-862b-62ca5e825663 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-unplugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f074f61b-b3b9-4a77-b8d9-c5a988cea53a req-aa94f6ad-d00f-410d-862b-62ca5e825663 service nova] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f074f61b-b3b9-4a77-b8d9-c5a988cea53a req-aa94f6ad-d00f-410d-862b-62ca5e825663 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f074f61b-b3b9-4a77-b8d9-c5a988cea53a req-aa94f6ad-d00f-410d-862b-62ca5e825663 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-f074f61b-b3b9-4a77-b8d9-c5a988cea53a req-aa94f6ad-d00f-410d-862b-62ca5e825663 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] No waiting events found dispatching network-vif-unplugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:03:22 user nova-compute[72000]: WARNING nova.compute.manager [req-f074f61b-b3b9-4a77-b8d9-c5a988cea53a req-aa94f6ad-d00f-410d-862b-62ca5e825663 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received unexpected event network-vif-unplugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 for instance with vm_state active and task_state None.
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquired lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:03:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:23 user nova-compute[72000]: INFO nova.network.neutron [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Port a8b153c0-727a-4d72-959b-93a317a0ecb4 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 16 18:03:23 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updating instance_info_cache with network_info: [{"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Releasing lock "refresh_cache-24b1035b-ae88-49a1-94f6-edc05ffce52a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae77af92-ec20-4e7a-8a64-b14b807b0848 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "interface-24b1035b-ae88-49a1-94f6-edc05ffce52a-a8b153c0-727a-4d72-959b-93a317a0ecb4" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.130s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-c453b84e-853c-4c4a-b6ed-2d15b5e023c6 req-ab14782f-fdee-445f-b8c3-84c1b2b247f7 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-plugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c453b84e-853c-4c4a-b6ed-2d15b5e023c6 req-ab14782f-fdee-445f-b8c3-84c1b2b247f7 service nova] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c453b84e-853c-4c4a-b6ed-2d15b5e023c6 req-ab14782f-fdee-445f-b8c3-84c1b2b247f7 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c453b84e-853c-4c4a-b6ed-2d15b5e023c6 req-ab14782f-fdee-445f-b8c3-84c1b2b247f7 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-c453b84e-853c-4c4a-b6ed-2d15b5e023c6 req-ab14782f-fdee-445f-b8c3-84c1b2b247f7 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] No waiting events found dispatching network-vif-plugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:03:24 user nova-compute[72000]: WARNING nova.compute.manager [req-c453b84e-853c-4c4a-b6ed-2d15b5e023c6 req-ab14782f-fdee-445f-b8c3-84c1b2b247f7 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received unexpected event network-vif-plugged-a8b153c0-727a-4d72-959b-93a317a0ecb4 for instance with vm_state active and task_state None.
Aug 16 18:03:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-c453b84e-853c-4c4a-b6ed-2d15b5e023c6 req-ab14782f-fdee-445f-b8c3-84c1b2b247f7 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-deleted-a8b153c0-727a-4d72-959b-93a317a0ecb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:03:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:03:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7105MB free_disk=23.912982940673828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a8532341-62b3-4c58-b3d8-db5440ad08c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 49796cab-9592-4761-8acd-f54c1219ffb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 0e7d8582-d732-4344-9f10-97ef34e8a391 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 24b1035b-ae88-49a1-94f6-edc05ffce52a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 682dbab8-ba72-4379-abaf-c35c9fff9d31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance cef1b726-614c-4b75-8b44-5bc62f235424 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRAKklqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6', 'attached_at': '', 'detached_at': '', 'volume_id': '324cf733-db4e-4589-9939-768be84be047', 'serial': '324cf733-db4e-4589-9939-768be84be047'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McTugyGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6', 'attached_at': '', 'detached_at': '', 'volume_id': 'dfd16c1f-5c8c-4508-a0c7-73f9732a3551', 'serial'} {{(pid=72000) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRAKklqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:33 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:33 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:33 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e059857-df86-4eb5-b828-24d929dd4072]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:03:33 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e2b7c7-b47e-41fd-bde2-90d8a99f016d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047] added
Aug 16 18:03:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0d46d4-8a7e-4c7c-9452-ca9598124d86]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9888d6ae-89db-46be-83de-3d9c718bf0f2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nRAKklqH {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nRAKklqH" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0640812-0f45-48ae-ae48-23ad93cda506]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nRAKklqH'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8608a92-b9f6-40c4-8069-646687deafeb]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42fbd48-2ae0-4c24-aaf3-ea765ac451c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:33 user nova-compute[72000]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:03:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:33 user nova-compute[72000]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:03:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dab2fe-4476-4ad8-87c7-689bd815c1ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047, portal: 172.16.0.220,3260]
Aug 16 18:03:33 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047, portal: 172.16.0.220,3260] successful.
Aug 16 18:03:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[248889b0-0e46-4f90-bbb1-e62d97f050d2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c23e6c-9578-4d46-a07c-bfdfe32ad952]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:33 user nova-compute[72000]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:03:33 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:03:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:33 user nova-compute[72000]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:03:33 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:03:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b62c887-a5b1-487c-956d-cb0af2aa6c8e]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:03:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRAKklqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:03:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26563396562396535', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563396562396535', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:03:34 user nova-compute[72000]: DEBUG nova.objects.instance [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lazy-loading 'flavor' on Instance uuid cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "f5fc020a-3be1-4e78-8825-89f06406e945" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:03:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:03:34 user nova-compute[72000]: INFO nova.compute.claims [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Claim successful on node user
Aug 16 18:03:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:03:35 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:03:35 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:03:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 166723584 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:03:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.965s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:03:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:03:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:03:35 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:03:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:03:36 user nova-compute[72000]: INFO nova.virt.block_device [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Booting with volume 66a71622-9305-481d-b3f1-ae05f26abde8 at /dev/vda
Aug 16 18:03:36 user nova-compute[72000]: DEBUG nova.policy [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bafbe976da14bcca011f17b17ca65ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e70b32f569148f598a9ea19771d9d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG os_brick.utils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e1c118-eab4-4d57-b238-8352a85b4af0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[349b9eea-cd1f-4adb-8897-40a99a9b7c93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 269484032 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19946c56-8ba6-4bc8-a6f6-04b1b2044973]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdf645a-ada0-435e-812b-93dabddb256c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:03:36 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:03:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6304df-d53a-411e-8eab-49fb14df8f31]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG os_brick.utils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating existing volume attachment record: 4014f71b-e158-45aa-b035-a3adf1bfc32e {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:03:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 411041792 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:03:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 574619648 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:03:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 761266176 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:03:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Successfully created port: ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:03:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 936378368 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 1050673152 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Successfully updated port: ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquired lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-9ad4da58-fd38-4386-8848-90f547fda3d7 req-87933b2c-5a88-4417-b117-c7455d4b2132 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-changed-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-9ad4da58-fd38-4386-8848-90f547fda3d7 req-87933b2c-5a88-4417-b117-c7455d4b2132 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Refreshing instance network info cache due to event network-changed-ff6674fb-0507-4b0e-a63e-b541fa45d07e. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9ad4da58-fd38-4386-8848-90f547fda3d7 req-87933b2c-5a88-4417-b117-c7455d4b2132 service nova] Acquiring lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:03:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating instance_info_cache with network_info: [{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Releasing lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Instance network_info: |[{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9ad4da58-fd38-4386-8848-90f547fda3d7 req-87933b2c-5a88-4417-b117-c7455d4b2132 service nova] Acquired lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG nova.network.neutron [req-9ad4da58-fd38-4386-8848-90f547fda3d7 req-87933b2c-5a88-4417-b117-c7455d4b2132 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Refreshing network info cache for port ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McTugyGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:39 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f10d28-b1da-402a-90b4-63175e5c2364]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[259be806-42e9-4e67-8d1f-86ac53629d65]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:39 user nova-compute[72000]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:03:39 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:03:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:39 user nova-compute[72000]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:03:39 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:03:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd010466f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551'): ({'sdd'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Removing single pathed devices sdd {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef5adda-0575-4152-82ea-5bca9da57c98]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c50a9-162b-403f-a475-01ed16201584]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Flushing IO for device /dev/sdd {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8799d7-7519-4413-ba4e-d197d6e2ab0f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9427134-00f2-44dc-81e5-ba7d718c5a28]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d213757-dc64-4086-b208-1a12a04f875c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aaef3d-25d5-4501-8bf7-241932642a29]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260]
Aug 16 18:03:39 user nova-compute[72000]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260] successful.
Aug 16 18:03:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG nova.network.neutron [req-9ad4da58-fd38-4386-8848-90f547fda3d7 req-87933b2c-5a88-4417-b117-c7455d4b2132 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updated VIF entry in instance network info cache for port ff6674fb-0507-4b0e-a63e-b541fa45d07e. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG nova.network.neutron [req-9ad4da58-fd38-4386-8848-90f547fda3d7 req-87933b2c-5a88-4417-b117-c7455d4b2132 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating instance_info_cache with network_info: [{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9632016-7b10-4062-ae5f-28adc26e8b17]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] <== disconnect_volume: return (322ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9ad4da58-fd38-4386-8848-90f547fda3d7 req-87933b2c-5a88-4417-b117-c7455d4b2132 service nova] Releasing lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRAKklqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6', 'attached_at': '', 'detached_at': '', 'volume_id': '324cf733-db4e-4589-9939-768be84be047', 'serial'} {{(pid=72000) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 18:03:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] swap_volume: removing Cinder connection for volume dfd16c1f-5c8c-4508-a0c7-73f9732a3551 {{(pid=72000) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 18:03:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Acquiring lock "49796cab-9592-4761-8acd-f54c1219ffb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "49796cab-9592-4761-8acd-f54c1219ffb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Acquiring lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:48 user nova-compute[72000]: INFO nova.compute.manager [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Terminating instance
Aug 16 18:03:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG nova.compute.manager [req-e800fbb1-1010-47e9-9f5b-f42c44a00c48 req-21d453c7-e517-4bf0-bf28-b18a9155b4d2 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received event network-vif-unplugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e800fbb1-1010-47e9-9f5b-f42c44a00c48 req-21d453c7-e517-4bf0-bf28-b18a9155b4d2 service nova] Acquiring lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e800fbb1-1010-47e9-9f5b-f42c44a00c48 req-21d453c7-e517-4bf0-bf28-b18a9155b4d2 service nova] Lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e800fbb1-1010-47e9-9f5b-f42c44a00c48 req-21d453c7-e517-4bf0-bf28-b18a9155b4d2 service nova] Lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG nova.compute.manager [req-e800fbb1-1010-47e9-9f5b-f42c44a00c48 req-21d453c7-e517-4bf0-bf28-b18a9155b4d2 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] No waiting events found dispatching network-vif-unplugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:03:48 user nova-compute[72000]: DEBUG nova.compute.manager [req-e800fbb1-1010-47e9-9f5b-f42c44a00c48 req-21d453c7-e517-4bf0-bf28-b18a9155b4d2 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received event network-vif-unplugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:03:49 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Instance destroyed successfully.
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lazy-loading 'resources' on Instance uuid 49796cab-9592-4761-8acd-f54c1219ffb9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1572808618',display_name='tempest-VolumesAssistedSnapshotsTest-server-1572808618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1572808618',id=6,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8wmqoDL/hggERLBRduVW0o5Zj79xnzT2HL10/2sfWMRuXePHzkuGckupNM0bWdy5Cv1XIIblxGnl0yRhvzdaq7+GddOFQT427VOD2mXcF08Y4Vk26veXGAXoCFANdbsQ==',key_name='tempest-keypair-1415915389',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92e666887ff3436ab1e0b019f9d7b888',ramdisk_id='',reservation_id='r-b7epkmpa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1424008607',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1424008607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d450b2d680c4c018f87695f7eca039d',uuid=49796cab-9592-4761-8acd-f54c1219ffb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "address": "fa:16:3e:2e:2a:35", "network": {"id": "9a48b52d-ed41-41d0-a5f9-4a51a64b73ac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1097559854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e666887ff3436ab1e0b019f9d7b888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d4fd2c-6f", "ovs_interfaceid": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Converting VIF {"id": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "address": "fa:16:3e:2e:2a:35", "network": {"id": "9a48b52d-ed41-41d0-a5f9-4a51a64b73ac", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1097559854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92e666887ff3436ab1e0b019f9d7b888", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d4fd2c-6f", "ovs_interfaceid": "05d4fd2c-6f16-49b4-9ed2-b9451611d094", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:2a:35,bridge_name='br-int',has_traffic_filtering=True,id=05d4fd2c-6f16-49b4-9ed2-b9451611d094,network=Network(9a48b52d-ed41-41d0-a5f9-4a51a64b73ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d4fd2c-6f') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_vif [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:2a:35,bridge_name='br-int',has_traffic_filtering=True,id=05d4fd2c-6f16-49b4-9ed2-b9451611d094,network=Network(9a48b52d-ed41-41d0-a5f9-4a51a64b73ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d4fd2c-6f') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] swap_volume: Updating volume dfd16c1f-5c8c-4508-a0c7-73f9732a3551 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "nRAKklqH", "auth_password": "Gp8Ys5gfBx9CyR", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "324cf733-db4e-4589-9939-768be84be047"}, "status": "reserved", "instance": "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6", "attached_at": "", "detached_at": "", "volume_id": "324cf733-db4e-4589-9939-768be84be047", "serial": "324cf733-db4e-4589-9939-768be84be047"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '324cf733-db4e-4589-9939-768be84be047', 'no_device': None, 'attachment_id': '7fbdb6ed-baa6-4d1e-a09a-eb5cf72e3e48'} {{(pid=72000) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05d4fd2c-6f, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-91851903-452e-4b60-9e24-c17349584e09 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 28.112s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:49 user nova-compute[72000]: INFO os_vif [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:2a:35,bridge_name='br-int',has_traffic_filtering=True,id=05d4fd2c-6f16-49b4-9ed2-b9451611d094,network=Network(9a48b52d-ed41-41d0-a5f9-4a51a64b73ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d4fd2c-6f')
Aug 16 18:03:49 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Deleting instance files /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9_del
Aug 16 18:03:49 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Deletion of /opt/stack/data/nova/instances/49796cab-9592-4761-8acd-f54c1219ffb9_del complete
Aug 16 18:03:49 user nova-compute[72000]: INFO nova.compute.manager [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:03:49 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Creating image(s)
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Ensure instance console log exists: /opt/stack/data/nova/instances/f5fc020a-3be1-4e78-8825-89f06406e945/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Start _get_guest_xml network_info=[{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkFJdhxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5fc020a-3be1-4e78-8825-89f06406e945', 'attached_at': '', 'detached_at': '', 'volume_id': '66a71622-9305-481d-b3f1-ae05f26abde8', 'serial': '66a71622-9305-481d-b3f1-ae05f26abde8'}, 'attachment_id': '4014f71b-e158-45aa-b035-a3adf1bfc32e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:03:49 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:03:49 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkFJdhxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:49 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:49 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:03:49 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c258af4-b332-4be8-a1ce-6d81d1cca819]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:03:49 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa738d11-1142-4856-a4b4-d4366fc8bfef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8] added
Aug 16 18:03:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a549b4-3978-421d-b255-a3cc7327c140]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[143c8cd0-272e-4fa5-8c36-0bd5569076ed]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HkFJdhxG {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HkFJdhxG" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea07d75-919a-4825-9258-bc4f64dc804c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HkFJdhxG'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[16652827-8384-4dd4-9c04-ea4734768e71]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[685a8dcb-c307-4b93-ab2f-1f46f0af0b3f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:49 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:03:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:49 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:03:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59332873-db2d-428f-b88f-32474409d621]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260]
Aug 16 18:03:49 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260] successful.
Aug 16 18:03:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7c29ea-a3c6-4f47-9f58-73512a351752]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a030f2-a223-41d7-9d25-792e6873448e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:50 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:50 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:03:50 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:03:50 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:03:50 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:03:50 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6ad40d-14ad-4724-81a5-535093f27d9e]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkFJdhxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.utils [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e071909-f627-440f-9b22-e9bad046762a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-dd947055-83d1-49c3-92a9-143dcc871cdf req-08603938-3b1f-4434-b534-ecfd6a15bfa2 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received event network-vif-plugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dd947055-83d1-49c3-92a9-143dcc871cdf req-08603938-3b1f-4434-b534-ecfd6a15bfa2 service nova] Acquiring lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dd947055-83d1-49c3-92a9-143dcc871cdf req-08603938-3b1f-4434-b534-ecfd6a15bfa2 service nova] Lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dd947055-83d1-49c3-92a9-143dcc871cdf req-08603938-3b1f-4434-b534-ecfd6a15bfa2 service nova] Lock "49796cab-9592-4761-8acd-f54c1219ffb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-dd947055-83d1-49c3-92a9-143dcc871cdf req-08603938-3b1f-4434-b534-ecfd6a15bfa2 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] No waiting events found dispatching network-vif-plugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:03:50 user nova-compute[72000]: WARNING nova.compute.manager [req-dd947055-83d1-49c3-92a9-143dcc871cdf req-08603938-3b1f-4434-b534-ecfd6a15bfa2 service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received unexpected event network-vif-plugged-05d4fd2c-6f16-49b4-9ed2-b9451611d094 for instance with vm_state active and task_state deleting.
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[169fb668-087e-4d52-8d9a-5056467b1d3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcd1f90-9a53-4cdb-a9d8-39caca7fc313]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0a3c9e-d984-4f13-b922-c133f5287075]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:03:50 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:03:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9a2047-35d1-4662-ba4d-465b732337b6]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:03:50 user nova-compute[72000]: DEBUG os_brick.utils [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23364326233623538', 'path': '/dev/sdd'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364326233623538', 'path': '/dev/sdd'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:03:51 user nova-compute[72000]: INFO nova.compute.manager [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Swapping volume 324cf733-db4e-4589-9939-768be84be047 for dfd16c1f-5c8c-4508-a0c7-73f9732a3551
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671854720',display_name='tempest-TestShelveInstance-server-1671854720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671854720',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy10SwZ4bXKRC0dKCPy6fa0uY+bnVm3aNRZ8sBCF4oDMA+nZgCk9jKcPb8d0QkfWiDIWgt1qbCCse8HMygOI1Yr5uM1Lf8XlRV1BZ+gXxaguTOxe6XXmYzzDCkeBftw0Q==',key_name='tempest-TestShelveInstance-381507571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e70b32f569148f598a9ea19771d9d64',ramdisk_id='',reservation_id='r-4l1srynu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1203105608',owner_user_name='tempest-TestShelveInstance-1203105608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:03:36Z,user_data=None,user_id='7bafbe976da14bcca011f17b17ca65ff',uuid=f5fc020a-3be1-4e78-8825-89f06406e945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converting VIF {"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.objects.instance [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lazy-loading 'pci_devices' on Instance uuid f5fc020a-3be1-4e78-8825-89f06406e945 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:03:51 user nova-compute[72000]:   <uuid>f5fc020a-3be1-4e78-8825-89f06406e945</uuid>
Aug 16 18:03:51 user nova-compute[72000]:   <name>instance-0000000d</name>
Aug 16 18:03:51 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:03:51 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:03:51 user nova-compute[72000]:   <metadata>
Aug 16 18:03:51 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:03:51 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:03:51 user nova-compute[72000]:       <nova:name>tempest-TestShelveInstance-server-1671854720</nova:name>
Aug 16 18:03:51 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:03:49</nova:creationTime>
Aug 16 18:03:51 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:03:51 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:03:51 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:03:51 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:03:51 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:03:51 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:03:51 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:03:51 user nova-compute[72000]:       <nova:owner>
Aug 16 18:03:51 user nova-compute[72000]:         <nova:user uuid="7bafbe976da14bcca011f17b17ca65ff">tempest-TestShelveInstance-1203105608-project-member</nova:user>
Aug 16 18:03:51 user nova-compute[72000]:         <nova:project uuid="9e70b32f569148f598a9ea19771d9d64">tempest-TestShelveInstance-1203105608</nova:project>
Aug 16 18:03:51 user nova-compute[72000]:       </nova:owner>
Aug 16 18:03:51 user nova-compute[72000]:       <nova:ports>
Aug 16 18:03:51 user nova-compute[72000]:         <nova:port uuid="ff6674fb-0507-4b0e-a63e-b541fa45d07e">
Aug 16 18:03:51 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 18:03:51 user nova-compute[72000]:         </nova:port>
Aug 16 18:03:51 user nova-compute[72000]:       </nova:ports>
Aug 16 18:03:51 user nova-compute[72000]:     </nova:instance>
Aug 16 18:03:51 user nova-compute[72000]:   </metadata>
Aug 16 18:03:51 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:03:51 user nova-compute[72000]:     <system>
Aug 16 18:03:51 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:03:51 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:03:51 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:03:51 user nova-compute[72000]:       <entry name="serial">f5fc020a-3be1-4e78-8825-89f06406e945</entry>
Aug 16 18:03:51 user nova-compute[72000]:       <entry name="uuid">f5fc020a-3be1-4e78-8825-89f06406e945</entry>
Aug 16 18:03:51 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:03:51 user nova-compute[72000]:     </system>
Aug 16 18:03:51 user nova-compute[72000]:   </sysinfo>
Aug 16 18:03:51 user nova-compute[72000]:   <os>
Aug 16 18:03:51 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:03:51 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:03:51 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:03:51 user nova-compute[72000]:   </os>
Aug 16 18:03:51 user nova-compute[72000]:   <features>
Aug 16 18:03:51 user nova-compute[72000]:     <acpi/>
Aug 16 18:03:51 user nova-compute[72000]:     <apic/>
Aug 16 18:03:51 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:03:51 user nova-compute[72000]:   </features>
Aug 16 18:03:51 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:03:51 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:03:51 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:03:51 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:03:51 user nova-compute[72000]:   </clock>
Aug 16 18:03:51 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:03:51 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:03:51 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:03:51 user nova-compute[72000]:   </cpu>
Aug 16 18:03:51 user nova-compute[72000]:   <devices>
Aug 16 18:03:51 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:03:51 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:03:51 user nova-compute[72000]:       <source dev="/dev/sdd"/>
Aug 16 18:03:51 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:03:51 user nova-compute[72000]:       <serial>66a71622-9305-481d-b3f1-ae05f26abde8</serial>
Aug 16 18:03:51 user nova-compute[72000]:     </disk>
Aug 16 18:03:51 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:03:51 user nova-compute[72000]:       <mac address="fa:16:3e:92:c9:51"/>
Aug 16 18:03:51 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:03:51 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:03:51 user nova-compute[72000]:       <target dev="tapff6674fb-05"/>
Aug 16 18:03:51 user nova-compute[72000]:     </interface>
Aug 16 18:03:51 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:03:51 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/f5fc020a-3be1-4e78-8825-89f06406e945/console.log" append="off"/>
Aug 16 18:03:51 user nova-compute[72000]:     </serial>
Aug 16 18:03:51 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:03:51 user nova-compute[72000]:     <video>
Aug 16 18:03:51 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:03:51 user nova-compute[72000]:     </video>
Aug 16 18:03:51 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:03:51 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:03:51 user nova-compute[72000]:     </rng>
Aug 16 18:03:51 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:03:51 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:03:51 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:03:51 user nova-compute[72000]:     </memballoon>
Aug 16 18:03:51 user nova-compute[72000]:   </devices>
Aug 16 18:03:51 user nova-compute[72000]: </domain>
Aug 16 18:03:51 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671854720',display_name='tempest-TestShelveInstance-server-1671854720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671854720',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy10SwZ4bXKRC0dKCPy6fa0uY+bnVm3aNRZ8sBCF4oDMA+nZgCk9jKcPb8d0QkfWiDIWgt1qbCCse8HMygOI1Yr5uM1Lf8XlRV1BZ+gXxaguTOxe6XXmYzzDCkeBftw0Q==',key_name='tempest-TestShelveInstance-381507571',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e70b32f569148f598a9ea19771d9d64',ramdisk_id='',reservation_id='r-4l1srynu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1203105608',owner_user_name='tempest-TestShelveInstance-1203105608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:03:36Z,user_data=None,user_id='7bafbe976da14bcca011f17b17ca65ff',uuid=f5fc020a-3be1-4e78-8825-89f06406e945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converting VIF {"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG os_vif [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff6674fb-05, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff6674fb-05, col_values=(('external_ids', {'iface-id': 'ff6674fb-0507-4b0e-a63e-b541fa45d07e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:c9:51', 'vm-uuid': 'f5fc020a-3be1-4e78-8825-89f06406e945'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:51 user nova-compute[72000]: INFO os_vif [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05')
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] No VIF found with MAC fa:16:3e:92:c9:51, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:03:51 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Took 1.95 seconds to deallocate network for instance.
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-b805fccb-f7fa-48e7-bd12-87224af14181 req-263dc47a-d1e5-44c1-85cf-2f98985783ff service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Received event network-vif-deleted-05d4fd2c-6f16-49b4-9ed2-b9451611d094 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:51 user nova-compute[72000]: INFO nova.compute.manager [req-b805fccb-f7fa-48e7-bd12-87224af14181 req-263dc47a-d1e5-44c1-85cf-2f98985783ff service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Neutron deleted interface 05d4fd2c-6f16-49b4-9ed2-b9451611d094; detaching it from the instance and deleting it from the info cache
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.network.neutron [req-b805fccb-f7fa-48e7-bd12-87224af14181 req-263dc47a-d1e5-44c1-85cf-2f98985783ff service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-b805fccb-f7fa-48e7-bd12-87224af14181 req-263dc47a-d1e5-44c1-85cf-2f98985783ff service nova] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Detach interface failed, port_id=05d4fd2c-6f16-49b4-9ed2-b9451611d094, reason: Instance 49796cab-9592-4761-8acd-f54c1219ffb9 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:03:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:51 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Deleted allocations for instance 49796cab-9592-4761-8acd-f54c1219ffb9
Aug 16 18:03:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a006a462-7aae-4a29-b0c3-95617ed2f426 tempest-VolumesAssistedSnapshotsTest-1424008607 tempest-VolumesAssistedSnapshotsTest-1424008607-project-member] Lock "49796cab-9592-4761-8acd-f54c1219ffb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.594s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-6be32fb6-17a0-4f4b-81e5-e5eb38468665 req-691d449c-b574-44d2-b3a0-b8ff5945d971 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6be32fb6-17a0-4f4b-81e5-e5eb38468665 req-691d449c-b574-44d2-b3a0-b8ff5945d971 service nova] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6be32fb6-17a0-4f4b-81e5-e5eb38468665 req-691d449c-b574-44d2-b3a0-b8ff5945d971 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6be32fb6-17a0-4f4b-81e5-e5eb38468665 req-691d449c-b574-44d2-b3a0-b8ff5945d971 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-6be32fb6-17a0-4f4b-81e5-e5eb38468665 req-691d449c-b574-44d2-b3a0-b8ff5945d971 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] No waiting events found dispatching network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:03:53 user nova-compute[72000]: WARNING nova.compute.manager [req-6be32fb6-17a0-4f4b-81e5-e5eb38468665 req-691d449c-b574-44d2-b3a0-b8ff5945d971 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received unexpected event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e for instance with vm_state building and task_state spawning.
Aug 16 18:03:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209034.8432143, f5fc020a-3be1-4e78-8825-89f06406e945 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:03:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] VM Resumed (Lifecycle Event)
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:03:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Instance spawned successfully.
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:03:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209034.844508, f5fc020a-3be1-4e78-8825-89f06406e945 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:03:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] VM Started (Lifecycle Event)
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:03:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:03:54 user nova-compute[72000]: INFO nova.compute.manager [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Took 5.29 seconds to spawn the instance on the hypervisor.
Aug 16 18:03:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:03:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-a810af99-8199-497c-9ff5-e0a2f42db54b req-24d4b134-eecd-4e4b-a725-a7997a9ded12 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:03:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a810af99-8199-497c-9ff5-e0a2f42db54b req-24d4b134-eecd-4e4b-a725-a7997a9ded12 service nova] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:03:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a810af99-8199-497c-9ff5-e0a2f42db54b req-24d4b134-eecd-4e4b-a725-a7997a9ded12 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:03:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a810af99-8199-497c-9ff5-e0a2f42db54b req-24d4b134-eecd-4e4b-a725-a7997a9ded12 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-a810af99-8199-497c-9ff5-e0a2f42db54b req-24d4b134-eecd-4e4b-a725-a7997a9ded12 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] No waiting events found dispatching network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:03:55 user nova-compute[72000]: WARNING nova.compute.manager [req-a810af99-8199-497c-9ff5-e0a2f42db54b req-24d4b134-eecd-4e4b-a725-a7997a9ded12 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received unexpected event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e for instance with vm_state building and task_state spawning.
Aug 16 18:03:55 user nova-compute[72000]: INFO nova.compute.manager [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Took 20.34 seconds to build instance.
Aug 16 18:03:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-83deb245-4263-45f6-964f-88db8f8e533c tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "f5fc020a-3be1-4e78-8825-89f06406e945" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.443s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:03:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:03:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McTugyGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6', 'attached_at': '', 'detached_at': '', 'volume_id': 'dfd16c1f-5c8c-4508-a0c7-73f9732a3551', 'serial': 'dfd16c1f-5c8c-4508-a0c7-73f9732a3551'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRAKklqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '324cf733-db4e-4589-9939-768be84be047'}, 'status': 'reserved', 'instance': 'cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6', 'attached_at': '', 'detached_at': '', 'volume_id': '324cf733-db4e-4589-9939-768be84be047', 'serial'} {{(pid=72000) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McTugyGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:02 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:04:02 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:04:02 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a58717b-f81b-4d62-be42-dba5a7f08a67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:04:02 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c51dd35-3dc0-4a1b-90fb-9a240db08a84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551] added
Aug 16 18:04:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafc00bf-f7db-483a-a0c5-9be844a20cd2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e6f585-e86d-4830-95b9-b82c9bbd1df1]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v McTugyGW {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v McTugyGW" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d46a951-b368-407c-86d7-e6cf1626b5a4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'McTugyGW'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66310c9-0979-4948-a753-e5b237a22e6d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "682dbab8-ba72-4379-abaf-c35c9fff9d31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:02 user nova-compute[72000]: INFO nova.compute.manager [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Terminating instance
Aug 16 18:04:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5de2d94-644c-4218-965d-85ddc684707c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:02 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:02 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:04:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:02 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:02 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:04:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4598f6a5-4f37-48b1-9aee-bc307813598b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260]
Aug 16 18:04:02 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260] successful.
Aug 16 18:04:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[824586b3-e8b5-4c97-9c2c-16ba2b6365dc]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab569d82-ae5d-4aae-83fa-f9e149f050c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:03 user nova-compute[72000]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:04:03 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:03 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:04:03 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:03 user nova-compute[72000]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:04:03 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:03 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:04:03 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8e2512-aa67-474e-875a-21c82f296773]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McTugyGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-2e80351f-760a-481b-8e06-1c7ab4856018 req-4f7600c4-4f93-43b3-a67a-f318cebe9e42 service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Received event network-vif-unplugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2e80351f-760a-481b-8e06-1c7ab4856018 req-4f7600c4-4f93-43b3-a67a-f318cebe9e42 service nova] Acquiring lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2e80351f-760a-481b-8e06-1c7ab4856018 req-4f7600c4-4f93-43b3-a67a-f318cebe9e42 service nova] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2e80351f-760a-481b-8e06-1c7ab4856018 req-4f7600c4-4f93-43b3-a67a-f318cebe9e42 service nova] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-2e80351f-760a-481b-8e06-1c7ab4856018 req-4f7600c4-4f93-43b3-a67a-f318cebe9e42 service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] No waiting events found dispatching network-vif-unplugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-2e80351f-760a-481b-8e06-1c7ab4856018 req-4f7600c4-4f93-43b3-a67a-f318cebe9e42 service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Received event network-vif-unplugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Instance destroyed successfully.
Aug 16 18:04:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lazy-loading 'resources' on Instance uuid 682dbab8-ba72-4379-abaf-c35c9fff9d31 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:02:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1234023889',display_name='tempest-ServersNegativeTestJSON-server-1234023889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1234023889',id=11,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:02:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae4b7b47c8c9413d828928c6132eb104',ramdisk_id='',reservation_id='r-6i3zm7m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-764876388',owner_user_name='tempest-ServersNegativeTestJSON-764876388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:02:21Z,user_data=None,user_id='7d24985b850c46e3bdb31296af169a23',uuid=682dbab8-ba72-4379-abaf-c35c9fff9d31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "address": "fa:16:3e:0a:94:95", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe55dd3-70", "ovs_interfaceid": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converting VIF {"id": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "address": "fa:16:3e:0a:94:95", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fe55dd3-70", "ovs_interfaceid": "8fe55dd3-70db-4ca5-a666-509aeb6aab2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:94:95,bridge_name='br-int',has_traffic_filtering=True,id=8fe55dd3-70db-4ca5-a666-509aeb6aab2d,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe55dd3-70') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG os_vif [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:94:95,bridge_name='br-int',has_traffic_filtering=True,id=8fe55dd3-70db-4ca5-a666-509aeb6aab2d,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe55dd3-70') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fe55dd3-70, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:03 user nova-compute[72000]: INFO os_vif [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:94:95,bridge_name='br-int',has_traffic_filtering=True,id=8fe55dd3-70db-4ca5-a666-509aeb6aab2d,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fe55dd3-70')
Aug 16 18:04:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Deleting instance files /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31_del
Aug 16 18:04:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Deletion of /opt/stack/data/nova/instances/682dbab8-ba72-4379-abaf-c35c9fff9d31_del complete
Aug 16 18:04:03 user nova-compute[72000]: INFO nova.compute.manager [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 18:04:03 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:04:03 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26564646663653965', 'path': '/dev/sde'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564646663653965', 'path': '/dev/sde'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG nova.objects.instance [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lazy-loading 'flavor' on Instance uuid cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209029.2109592, 49796cab-9592-4761-8acd-f54c1219ffb9 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:04:04 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] VM Stopped (Lifecycle Event)
Aug 16 18:04:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-decbdf7b-0dc9-4874-9e01-9e152f20c80b None None] [instance: 49796cab-9592-4761-8acd-f54c1219ffb9] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:04 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Took 0.62 seconds to deallocate network for instance.
Aug 16 18:04:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "0e7d8582-d732-4344-9f10-97ef34e8a391" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:04 user nova-compute[72000]: INFO nova.compute.manager [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Terminating instance
Aug 16 18:04:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 114294784 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-54cd4f83-ead3-4ff5-9216-0f5acb3e8f77 req-adacc231-2317-4ad8-85f4-739082f1f95e service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Received event network-vif-plugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54cd4f83-ead3-4ff5-9216-0f5acb3e8f77 req-adacc231-2317-4ad8-85f4-739082f1f95e service nova] Acquiring lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54cd4f83-ead3-4ff5-9216-0f5acb3e8f77 req-adacc231-2317-4ad8-85f4-739082f1f95e service nova] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54cd4f83-ead3-4ff5-9216-0f5acb3e8f77 req-adacc231-2317-4ad8-85f4-739082f1f95e service nova] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-54cd4f83-ead3-4ff5-9216-0f5acb3e8f77 req-adacc231-2317-4ad8-85f4-739082f1f95e service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] No waiting events found dispatching network-vif-plugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:05 user nova-compute[72000]: WARNING nova.compute.manager [req-54cd4f83-ead3-4ff5-9216-0f5acb3e8f77 req-adacc231-2317-4ad8-85f4-739082f1f95e service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Received unexpected event network-vif-plugged-8fe55dd3-70db-4ca5-a666-509aeb6aab2d for instance with vm_state deleted and task_state None.
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-54cd4f83-ead3-4ff5-9216-0f5acb3e8f77 req-adacc231-2317-4ad8-85f4-739082f1f95e service nova] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Received event network-vif-deleted-8fe55dd3-70db-4ca5-a666-509aeb6aab2d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.824s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:05 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Deleted allocations for instance 682dbab8-ba72-4379-abaf-c35c9fff9d31
Aug 16 18:04:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 250609664 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Instance destroyed successfully.
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lazy-loading 'resources' on Instance uuid 0e7d8582-d732-4344-9f10-97ef34e8a391 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-976895130',display_name='tempest-AttachSCSIVolumeTestJSON-server-976895130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-976895130',id=8,image_ref='9a0d1ddd-def5-4e2e-b574-2941a59345f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqeyjKZ0PfZy3hfXxBqhiJQOO+5U2NOJ1KVyVUhjZF2iF5tUYghJQ6sbdZHqOfcHdN/9TAz1/m7XKA8UWZaTv/v9cFjpx5CifoipNfA+k+JL8Dc8yK4+w47b7XIw8Rs9A==',key_name='tempest-keypair-955334326',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d14e1ecd4624734942e175ef7bf14ac',ramdisk_id='',reservation_id='r-uqfuxk21',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9a0d1ddd-def5-4e2e-b574-2941a59345f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2142377259',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2142377259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eef79f384ee140a28ffa038f39c104e7',uuid=0e7d8582-d732-4344-9f10-97ef34e8a391,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Converting VIF {"id": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "address": "fa:16:3e:51:dd:e0", "network": {"id": "fc83f13c-fe44-45c7-a69b-d7b8bd907e37", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-471516549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d14e1ecd4624734942e175ef7bf14ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c59111e-ec", "ovs_interfaceid": "5c59111e-ecfb-4d21-89e2-1f2b5f1c5042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:dd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5c59111e-ecfb-4d21-89e2-1f2b5f1c5042,network=Network(fc83f13c-fe44-45c7-a69b-d7b8bd907e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59111e-ec') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG os_vif [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:dd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5c59111e-ecfb-4d21-89e2-1f2b5f1c5042,network=Network(fc83f13c-fe44-45c7-a69b-d7b8bd907e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59111e-ec') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c59111e-ec, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:05 user nova-compute[72000]: INFO os_vif [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:dd:e0,bridge_name='br-int',has_traffic_filtering=True,id=5c59111e-ecfb-4d21-89e2-1f2b5f1c5042,network=Network(fc83f13c-fe44-45c7-a69b-d7b8bd907e37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c59111e-ec')
Aug 16 18:04:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Deleting instance files /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391_del
Aug 16 18:04:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Deletion of /opt/stack/data/nova/instances/0e7d8582-d732-4344-9f10-97ef34e8a391_del complete
Aug 16 18:04:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0a756d9c-3779-4767-a7b1-9121e6d179b6 tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "682dbab8-ba72-4379-abaf-c35c9fff9d31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.043s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:05 user nova-compute[72000]: INFO nova.compute.manager [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 16 18:04:05 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:04:05 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-64330f94-ba95-44bb-8c82-3e6654271d0c req-2b40dde8-e188-4179-9cf6-3cafde9d6111 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received event network-vif-unplugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-64330f94-ba95-44bb-8c82-3e6654271d0c req-2b40dde8-e188-4179-9cf6-3cafde9d6111 service nova] Acquiring lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-64330f94-ba95-44bb-8c82-3e6654271d0c req-2b40dde8-e188-4179-9cf6-3cafde9d6111 service nova] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-64330f94-ba95-44bb-8c82-3e6654271d0c req-2b40dde8-e188-4179-9cf6-3cafde9d6111 service nova] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-64330f94-ba95-44bb-8c82-3e6654271d0c req-2b40dde8-e188-4179-9cf6-3cafde9d6111 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] No waiting events found dispatching network-vif-unplugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-64330f94-ba95-44bb-8c82-3e6654271d0c req-2b40dde8-e188-4179-9cf6-3cafde9d6111 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received event network-vif-unplugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 409993216 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 552599552 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:04:06 user nova-compute[72000]: INFO nova.compute.claims [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Claim successful on node user
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 697303040 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:07 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Took 1.60 seconds to deallocate network for instance.
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-29dd5fc6-21ad-410e-9dff-2c2c22f92a73 req-d5885e16-f195-488c-8d04-2006dd1f87c9 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received event network-vif-deleted-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:07 user nova-compute[72000]: INFO nova.compute.manager [req-29dd5fc6-21ad-410e-9dff-2c2c22f92a73 req-d5885e16-f195-488c-8d04-2006dd1f87c9 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Neutron deleted interface 5c59111e-ecfb-4d21-89e2-1f2b5f1c5042; detaching it from the instance and deleting it from the info cache
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.network.neutron [req-29dd5fc6-21ad-410e-9dff-2c2c22f92a73 req-d5885e16-f195-488c-8d04-2006dd1f87c9 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-29dd5fc6-21ad-410e-9dff-2c2c22f92a73 req-d5885e16-f195-488c-8d04-2006dd1f87c9 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Detach interface failed, port_id=5c59111e-ecfb-4d21-89e2-1f2b5f1c5042, reason: Instance 0e7d8582-d732-4344-9f10-97ef34e8a391 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.871s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.041s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 859832320 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:04:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:04:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.policy [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '090a1c872b734d0bb3daede325eca0df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad509a974084c17ac6ffac36ca72c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:04:08 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Creating image(s)
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "/opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "/opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-e99aed04-3f6d-4be7-8f05-cd689021825a req-c28650f1-080e-4b0f-92fc-0aef2e712526 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received event network-vif-plugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e99aed04-3f6d-4be7-8f05-cd689021825a req-c28650f1-080e-4b0f-92fc-0aef2e712526 service nova] Acquiring lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e99aed04-3f6d-4be7-8f05-cd689021825a req-c28650f1-080e-4b0f-92fc-0aef2e712526 service nova] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e99aed04-3f6d-4be7-8f05-cd689021825a req-c28650f1-080e-4b0f-92fc-0aef2e712526 service nova] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-e99aed04-3f6d-4be7-8f05-cd689021825a req-c28650f1-080e-4b0f-92fc-0aef2e712526 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] No waiting events found dispatching network-vif-plugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:08 user nova-compute[72000]: WARNING nova.compute.manager [req-e99aed04-3f6d-4be7-8f05-cd689021825a req-c28650f1-080e-4b0f-92fc-0aef2e712526 service nova] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Received unexpected event network-vif-plugged-5c59111e-ecfb-4d21-89e2-1f2b5f1c5042 for instance with vm_state deleted and task_state None.
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 975175680 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.259s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.736s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.211s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:08 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Deleted allocations for instance 0e7d8582-d732-4344-9f10-97ef34e8a391
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk 1073741824" returned: 0 in 0.067s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d10c9ab-9215-47b3-bf4d-52e67cd187e7 tempest-AttachSCSIVolumeTestJSON-2142377259 tempest-AttachSCSIVolumeTestJSON-2142377259-project-member] Lock "0e7d8582-d732-4344-9f10-97ef34e8a391" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.934s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.network.neutron [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Successfully created port: 7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nRAKklqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '324cf733-db4e-4589-9939-768be84be047'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:08 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:04:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:04:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ca0180-6710-4f1a-85f0-293c33c9f70d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3817c1d2-0986-4241-961c-948c8d87af2c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:09 user nova-compute[72000]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:04:09 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:09 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:04:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:09 user nova-compute[72000]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:04:09 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:09 user nova-compute[72000]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 (non-flash)
Aug 16 18:04:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01c85caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Cannot resize image /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.objects.instance [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lazy-loading 'migration_context' on Instance uuid 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Ensure instance console log exists: /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f388dea-b613-477e-84ae-cb6ff830f928]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e32204-d35b-4dd2-8e04-c90c66b38a1b]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[277aca06-03b2-4f15-9868-98e9c8633873]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c10aa4-abcd-436c-8cac-2ba34bda1864]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b67e36c-34c5-434e-8ab3-6b220d7cf75e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2f9997-30b4-4fd9-9d6c-2cd67e79c05e]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047, portal: 172.16.0.220,3260]
Aug 16 18:04:09 user nova-compute[72000]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047, portal: 172.16.0.220,3260] successful.
Aug 16 18:04:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324cf733-db4e-4589-9939-768be84be047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d48eb35-7d78-481f-905d-c37d28bd0322]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] <== disconnect_volume: return (321ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McTugyGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6', 'attached_at': '', 'detached_at': '', 'volume_id': 'dfd16c1f-5c8c-4508-a0c7-73f9732a3551', 'serial'} {{(pid=72000) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] swap_volume: removing Cinder connection for volume 324cf733-db4e-4589-9939-768be84be047 {{(pid=72000) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.network.neutron [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Successfully updated port: 7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "refresh_cache-3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquired lock "refresh_cache-3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.network.neutron [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-44678a7f-5de2-4602-b759-6480a86a7def req-60b6b044-e07a-484f-988f-fc5b5f8d7511 service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Received event network-changed-7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-44678a7f-5de2-4602-b759-6480a86a7def req-60b6b044-e07a-484f-988f-fc5b5f8d7511 service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Refreshing instance network info cache due to event network-changed-7782d6cc-6b1b-4029-92d3-03b8fd65b90a. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-44678a7f-5de2-4602-b759-6480a86a7def req-60b6b044-e07a-484f-988f-fc5b5f8d7511 service nova] Acquiring lock "refresh_cache-3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:09 user nova-compute[72000]: DEBUG nova.network.neutron [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.network.neutron [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Updating instance_info_cache with network_info: [{"id": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "address": "fa:16:3e:d0:ac:3e", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782d6cc-6b", "ovs_interfaceid": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Releasing lock "refresh_cache-3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Instance network_info: |[{"id": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "address": "fa:16:3e:d0:ac:3e", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782d6cc-6b", "ovs_interfaceid": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-44678a7f-5de2-4602-b759-6480a86a7def req-60b6b044-e07a-484f-988f-fc5b5f8d7511 service nova] Acquired lock "refresh_cache-3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.network.neutron [req-44678a7f-5de2-4602-b759-6480a86a7def req-60b6b044-e07a-484f-988f-fc5b5f8d7511 service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Refreshing network info cache for port 7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Start _get_guest_xml network_info=[{"id": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "address": "fa:16:3e:d0:ac:3e", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782d6cc-6b", "ovs_interfaceid": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:04:10 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:04:10 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1181340656',display_name='tempest-VolumesAdminNegativeTest-server-1181340656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1181340656',id=14,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad509a974084c17ac6ffac36ca72c50',ramdisk_id='',reservation_id='r-cu1v1aia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-127684415',owner_user_name='tempest-VolumesAdminNegativeTest-127684415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:08Z,user_data=None,user_id='090a1c872b734d0bb3daede325eca0df',uuid=3e53d54d-0eb5-4ff9-ad1c-8c1277697a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "address": "fa:16:3e:d0:ac:3e", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782d6cc-6b", "ovs_interfaceid": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converting VIF {"id": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "address": "fa:16:3e:d0:ac:3e", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782d6cc-6b", "ovs_interfaceid": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=7782d6cc-6b1b-4029-92d3-03b8fd65b90a,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7782d6cc-6b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.objects.instance [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:04:10 user nova-compute[72000]:   <uuid>3e53d54d-0eb5-4ff9-ad1c-8c1277697a23</uuid>
Aug 16 18:04:10 user nova-compute[72000]:   <name>instance-0000000e</name>
Aug 16 18:04:10 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:04:10 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:04:10 user nova-compute[72000]:   <metadata>
Aug 16 18:04:10 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:04:10 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:04:10 user nova-compute[72000]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1181340656</nova:name>
Aug 16 18:04:10 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:04:10</nova:creationTime>
Aug 16 18:04:10 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:04:10 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:04:10 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:04:10 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:04:10 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:04:10 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:04:10 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:04:10 user nova-compute[72000]:       <nova:owner>
Aug 16 18:04:10 user nova-compute[72000]:         <nova:user uuid="090a1c872b734d0bb3daede325eca0df">tempest-VolumesAdminNegativeTest-127684415-project-member</nova:user>
Aug 16 18:04:10 user nova-compute[72000]:         <nova:project uuid="0ad509a974084c17ac6ffac36ca72c50">tempest-VolumesAdminNegativeTest-127684415</nova:project>
Aug 16 18:04:10 user nova-compute[72000]:       </nova:owner>
Aug 16 18:04:10 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:04:10 user nova-compute[72000]:       <nova:ports>
Aug 16 18:04:10 user nova-compute[72000]:         <nova:port uuid="7782d6cc-6b1b-4029-92d3-03b8fd65b90a">
Aug 16 18:04:10 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 18:04:10 user nova-compute[72000]:         </nova:port>
Aug 16 18:04:10 user nova-compute[72000]:       </nova:ports>
Aug 16 18:04:10 user nova-compute[72000]:     </nova:instance>
Aug 16 18:04:10 user nova-compute[72000]:   </metadata>
Aug 16 18:04:10 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:04:10 user nova-compute[72000]:     <system>
Aug 16 18:04:10 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:04:10 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:04:10 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:04:10 user nova-compute[72000]:       <entry name="serial">3e53d54d-0eb5-4ff9-ad1c-8c1277697a23</entry>
Aug 16 18:04:10 user nova-compute[72000]:       <entry name="uuid">3e53d54d-0eb5-4ff9-ad1c-8c1277697a23</entry>
Aug 16 18:04:10 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:04:10 user nova-compute[72000]:     </system>
Aug 16 18:04:10 user nova-compute[72000]:   </sysinfo>
Aug 16 18:04:10 user nova-compute[72000]:   <os>
Aug 16 18:04:10 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:04:10 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:04:10 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:04:10 user nova-compute[72000]:   </os>
Aug 16 18:04:10 user nova-compute[72000]:   <features>
Aug 16 18:04:10 user nova-compute[72000]:     <acpi/>
Aug 16 18:04:10 user nova-compute[72000]:     <apic/>
Aug 16 18:04:10 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:04:10 user nova-compute[72000]:   </features>
Aug 16 18:04:10 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:04:10 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:04:10 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:04:10 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:04:10 user nova-compute[72000]:   </clock>
Aug 16 18:04:10 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:04:10 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:04:10 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:04:10 user nova-compute[72000]:   </cpu>
Aug 16 18:04:10 user nova-compute[72000]:   <devices>
Aug 16 18:04:10 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:04:10 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:04:10 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk"/>
Aug 16 18:04:10 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:04:10 user nova-compute[72000]:     </disk>
Aug 16 18:04:10 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:04:10 user nova-compute[72000]:       <mac address="fa:16:3e:d0:ac:3e"/>
Aug 16 18:04:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:04:10 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:04:10 user nova-compute[72000]:       <target dev="tap7782d6cc-6b"/>
Aug 16 18:04:10 user nova-compute[72000]:     </interface>
Aug 16 18:04:10 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:04:10 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/console.log" append="off"/>
Aug 16 18:04:10 user nova-compute[72000]:     </serial>
Aug 16 18:04:10 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:04:10 user nova-compute[72000]:     <video>
Aug 16 18:04:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:04:10 user nova-compute[72000]:     </video>
Aug 16 18:04:10 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:04:10 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:04:10 user nova-compute[72000]:     </rng>
Aug 16 18:04:10 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:04:10 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:04:10 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:04:10 user nova-compute[72000]:     </memballoon>
Aug 16 18:04:10 user nova-compute[72000]:   </devices>
Aug 16 18:04:10 user nova-compute[72000]: </domain>
Aug 16 18:04:10 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1181340656',display_name='tempest-VolumesAdminNegativeTest-server-1181340656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1181340656',id=14,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ad509a974084c17ac6ffac36ca72c50',ramdisk_id='',reservation_id='r-cu1v1aia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-127684415',owner_user_name='tempest-VolumesAdminNegativeTest-127684415-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:08Z,user_data=None,user_id='090a1c872b734d0bb3daede325eca0df',uuid=3e53d54d-0eb5-4ff9-ad1c-8c1277697a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "address": "fa:16:3e:d0:ac:3e", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782d6cc-6b", "ovs_interfaceid": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converting VIF {"id": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "address": "fa:16:3e:d0:ac:3e", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782d6cc-6b", "ovs_interfaceid": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=7782d6cc-6b1b-4029-92d3-03b8fd65b90a,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7782d6cc-6b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG os_vif [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=7782d6cc-6b1b-4029-92d3-03b8fd65b90a,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7782d6cc-6b') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7782d6cc-6b, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7782d6cc-6b, col_values=(('external_ids', {'iface-id': '7782d6cc-6b1b-4029-92d3-03b8fd65b90a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:ac:3e', 'vm-uuid': '3e53d54d-0eb5-4ff9-ad1c-8c1277697a23'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:10 user nova-compute[72000]: INFO os_vif [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=7782d6cc-6b1b-4029-92d3-03b8fd65b90a,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7782d6cc-6b')
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] No VIF found with MAC fa:16:3e:d0:ac:3e, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.network.neutron [req-44678a7f-5de2-4602-b759-6480a86a7def req-60b6b044-e07a-484f-988f-fc5b5f8d7511 service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Updated VIF entry in instance network info cache for port 7782d6cc-6b1b-4029-92d3-03b8fd65b90a. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG nova.network.neutron [req-44678a7f-5de2-4602-b759-6480a86a7def req-60b6b044-e07a-484f-988f-fc5b5f8d7511 service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Updating instance_info_cache with network_info: [{"id": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "address": "fa:16:3e:d0:ac:3e", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782d6cc-6b", "ovs_interfaceid": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-44678a7f-5de2-4602-b759-6480a86a7def req-60b6b044-e07a-484f-988f-fc5b5f8d7511 service nova] Releasing lock "refresh_cache-3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-3829924b-eb7a-4774-9aa5-c8055d3fb92a req-30da2c7d-fb7e-470d-9ccc-95192bfe9b4f service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Received event network-vif-plugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3829924b-eb7a-4774-9aa5-c8055d3fb92a req-30da2c7d-fb7e-470d-9ccc-95192bfe9b4f service nova] Acquiring lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3829924b-eb7a-4774-9aa5-c8055d3fb92a req-30da2c7d-fb7e-470d-9ccc-95192bfe9b4f service nova] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3829924b-eb7a-4774-9aa5-c8055d3fb92a req-30da2c7d-fb7e-470d-9ccc-95192bfe9b4f service nova] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-3829924b-eb7a-4774-9aa5-c8055d3fb92a req-30da2c7d-fb7e-470d-9ccc-95192bfe9b4f service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] No waiting events found dispatching network-vif-plugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:12 user nova-compute[72000]: WARNING nova.compute.manager [req-3829924b-eb7a-4774-9aa5-c8055d3fb92a req-30da2c7d-fb7e-470d-9ccc-95192bfe9b4f service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Received unexpected event network-vif-plugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a for instance with vm_state building and task_state spawning.
Aug 16 18:04:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] swap_volume: Updating volume 324cf733-db4e-4589-9939-768be84be047 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "McTugyGW", "auth_password": "GecKPI6fu9nBlx", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "dfd16c1f-5c8c-4508-a0c7-73f9732a3551"}, "status": "reserved", "instance": "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6", "attached_at": "", "detached_at": "", "volume_id": "dfd16c1f-5c8c-4508-a0c7-73f9732a3551", "serial": "dfd16c1f-5c8c-4508-a0c7-73f9732a3551"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'dfd16c1f-5c8c-4508-a0c7-73f9732a3551', 'no_device': None, 'attachment_id': 'd6a0b3c4-2fc6-448b-8fea-5e8e5cd3823f'} {{(pid=72000) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.007s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-061cb33c-f9eb-4f54-bb09-a51812938811 tempest-TestVolumeSwap-1212008144 tempest-TestVolumeSwap-1212008144-project-admin] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.457s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG nova.objects.instance [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'flavor' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:12 user nova-compute[72000]: INFO nova.compute.manager [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Attaching volume 5a3bba8f-57f3-428b-87f7-c48a475f84fa to /dev/vdb
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:12 user nova-compute[72000]: INFO nova.compute.manager [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Terminating instance
Aug 16 18:04:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG os_brick.utils [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e923404a-a71b-436a-b836-37c6d8c377cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fef4f0-6db9-475e-9d55-6fc111a80361]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f23363-bf26-4267-af60-eec9fb4cb01f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[074ad45b-b09b-425a-af26-96bfcfbc199f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:04:12 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae041764-260e-4154-84b0-ed90005d8ffc]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG os_brick.utils [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating existing volume attachment record: 7b02afb3-38b1-42d8-93cf-3e00d68bea87 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:13 user nova-compute[72000]: INFO nova.compute.manager [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Detaching volume dfd16c1f-5c8c-4508-a0c7-73f9732a3551
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-b3d868d3-715f-40c6-a9f2-2f952dff0b7a req-b4a8f0dd-b4a8-406a-8a69-b19677709f19 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-unplugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b3d868d3-715f-40c6-a9f2-2f952dff0b7a req-b4a8f0dd-b4a8-406a-8a69-b19677709f19 service nova] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b3d868d3-715f-40c6-a9f2-2f952dff0b7a req-b4a8f0dd-b4a8-406a-8a69-b19677709f19 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b3d868d3-715f-40c6-a9f2-2f952dff0b7a req-b4a8f0dd-b4a8-406a-8a69-b19677709f19 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-b3d868d3-715f-40c6-a9f2-2f952dff0b7a req-b4a8f0dd-b4a8-406a-8a69-b19677709f19 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] No waiting events found dispatching network-vif-unplugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-b3d868d3-715f-40c6-a9f2-2f952dff0b7a req-b4a8f0dd-b4a8-406a-8a69-b19677709f19 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-unplugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:13 user nova-compute[72000]: INFO nova.virt.block_device [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Attempting to driver detach volume dfd16c1f-5c8c-4508-a0c7-73f9732a3551 from mountpoint /dev/vdb
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Attempting to detach device vdb from instance cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:04:13 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:04:13 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:04:13 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:04:13 user nova-compute[72000]:   <serial>dfd16c1f-5c8c-4508-a0c7-73f9732a3551</serial>
Aug 16 18:04:13 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:04:13 user nova-compute[72000]: </disk>
Aug 16 18:04:13 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:04:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Successfully detached device vdb from instance cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 from the persistent domain config.
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:04:13 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:04:13 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:04:13 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:04:13 user nova-compute[72000]:   <serial>dfd16c1f-5c8c-4508-a0c7-73f9732a3551</serial>
Aug 16 18:04:13 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:04:13 user nova-compute[72000]: </disk>
Aug 16 18:04:13 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209053.6727839, cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:04:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Successfully detached device vdb from instance cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 from the live domain config.
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McTugyGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'dfd16c1f-5c8c-4508-a0c7-73f9732a3551'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:13 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Instance destroyed successfully.
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.objects.instance [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lazy-loading 'resources' on Instance uuid 24b1035b-ae88-49a1-94f6-edc05ffce52a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-71010681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-71010681',id=9,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBItXYqUoCpbqB6nSOayr8Vmqi37fPWCEeevSnocKUkNBleJi6mxX7ey3iNWYzB6KMn1zWiw2auNdGp5nEMlxZXHrlq22uXueVa1zdbdPsbcd4KjbcH3ueYvIsSHmeZYEw==',key_name='tempest-keypair-1147753708',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='675f746e18c248c7a817617bf6a08e0e',ramdisk_id='',reservation_id='r-ae811ic6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487068983',owner_user_name='tempest-TaggedAttachmentsTest-1487068983-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fce8ded340af4611b075dbf018443714',uuid=24b1035b-ae88-49a1-94f6-edc05ffce52a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converting VIF {"id": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "address": "fa:16:3e:c1:f8:fb", "network": {"id": "24151e0c-d32a-4c64-8866-25d0d95386d3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2034839983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675f746e18c248c7a817617bf6a08e0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a9af2dc-be", "ovs_interfaceid": "1a9af2dc-bef9-4a0f-993d-1b61022dda5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:f8:fb,bridge_name='br-int',has_traffic_filtering=True,id=1a9af2dc-bef9-4a0f-993d-1b61022dda5d,network=Network(24151e0c-d32a-4c64-8866-25d0d95386d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9af2dc-be') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_vif [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:f8:fb,bridge_name='br-int',has_traffic_filtering=True,id=1a9af2dc-bef9-4a0f-993d-1b61022dda5d,network=Network(24151e0c-d32a-4c64-8866-25d0d95386d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9af2dc-be') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4e78f9-0c17-49cd-b43e-32a07b3491f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a9af2dc-be, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:13 user nova-compute[72000]: INFO os_vif [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:f8:fb,bridge_name='br-int',has_traffic_filtering=True,id=1a9af2dc-bef9-4a0f-993d-1b61022dda5d,network=Network(24151e0c-d32a-4c64-8866-25d0d95386d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a9af2dc-be')
Aug 16 18:04:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Deleting instance files /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a_del
Aug 16 18:04:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Deletion of /opt/stack/data/nova/instances/24b1035b-ae88-49a1-94f6-edc05ffce52a_del complete
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1df57c-f9f4-46c9-9083-5e01c576a2cc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:13 user nova-compute[72000]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:04:13 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:13 user nova-compute[72000]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 (non-flash)
Aug 16 18:04:13 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01c85caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551'): ({'sde'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Removing single pathed devices sde {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[76317b73-430e-448e-bb5b-30e0686bd234]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e65c1a-283d-487c-90c0-460fcc0faac4]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Flushing IO for device /dev/sde {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:13 user nova-compute[72000]: INFO nova.compute.manager [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9b2909-d225-4cf1-8e0e-df67a5297e24]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.092s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21d2274-0cdd-433d-9ddc-bf54c4fccb6a]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6de6902-f711-46bc-89e6-f60307030b3f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f186df9b-5edf-4ceb-bd56-77e63fcdeadd]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260]
Aug 16 18:04:14 user nova-compute[72000]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551, portal: 172.16.0.220,3260] successful.
Aug 16 18:04:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfd16c1f-5c8c-4508-a0c7-73f9732a3551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d68b8dd-0afc-4457-b413-1d85c681f04c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] <== disconnect_volume: return (377ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-23bf2e5e-c715-4552-98a4-2c7098c40604 req-96bf0310-51d7-4e4a-b1e8-180d173e45a0 service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Received event network-vif-plugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-23bf2e5e-c715-4552-98a4-2c7098c40604 req-96bf0310-51d7-4e4a-b1e8-180d173e45a0 service nova] Acquiring lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-23bf2e5e-c715-4552-98a4-2c7098c40604 req-96bf0310-51d7-4e4a-b1e8-180d173e45a0 service nova] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-23bf2e5e-c715-4552-98a4-2c7098c40604 req-96bf0310-51d7-4e4a-b1e8-180d173e45a0 service nova] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-23bf2e5e-c715-4552-98a4-2c7098c40604 req-96bf0310-51d7-4e4a-b1e8-180d173e45a0 service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] No waiting events found dispatching network-vif-plugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:14 user nova-compute[72000]: WARNING nova.compute.manager [req-23bf2e5e-c715-4552-98a4-2c7098c40604 req-96bf0310-51d7-4e4a-b1e8-180d173e45a0 service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Received unexpected event network-vif-plugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a for instance with vm_state building and task_state spawning.
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209054.2794297, 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:04:14 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] VM Resumed (Lifecycle Event)
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:04:14 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Instance spawned successfully.
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:04:14 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209054.2930863, 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:04:14 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] VM Started (Lifecycle Event)
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:04:14 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:04:14 user nova-compute[72000]: INFO nova.compute.manager [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 16 18:04:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:14 user nova-compute[72000]: INFO nova.compute.manager [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Took 7.77 seconds to build instance.
Aug 16 18:04:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48b2bbb8-1273-436e-a539-1dd56709a34d tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.960s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-e1de8551-fa39-4af2-8229-2481756d02f1 req-06f36bdf-a770-49a0-936a-2feb71f2a571 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-plugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e1de8551-fa39-4af2-8229-2481756d02f1 req-06f36bdf-a770-49a0-936a-2feb71f2a571 service nova] Acquiring lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e1de8551-fa39-4af2-8229-2481756d02f1 req-06f36bdf-a770-49a0-936a-2feb71f2a571 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e1de8551-fa39-4af2-8229-2481756d02f1 req-06f36bdf-a770-49a0-936a-2feb71f2a571 service nova] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-e1de8551-fa39-4af2-8229-2481756d02f1 req-06f36bdf-a770-49a0-936a-2feb71f2a571 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] No waiting events found dispatching network-vif-plugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:15 user nova-compute[72000]: WARNING nova.compute.manager [req-e1de8551-fa39-4af2-8229-2481756d02f1 req-06f36bdf-a770-49a0-936a-2feb71f2a571 service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received unexpected event network-vif-plugged-1a9af2dc-bef9-4a0f-993d-1b61022dda5d for instance with vm_state active and task_state deleting.
Aug 16 18:04:15 user nova-compute[72000]: DEBUG nova.objects.instance [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lazy-loading 'flavor' on Instance uuid cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:15 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Took 1.37 seconds to deallocate network for instance.
Aug 16 18:04:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-edba3845-a9c1-44b9-be95-1ca84b8f628d tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.264s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:04:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:15 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Deleted allocations for instance 24b1035b-ae88-49a1-94f6-edc05ffce52a
Aug 16 18:04:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6bf690b3-dc34-4c10-9718-ab2ebd5f11f9 tempest-TaggedAttachmentsTest-1487068983 tempest-TaggedAttachmentsTest-1487068983-project-member] Lock "24b1035b-ae88-49a1-94f6-edc05ffce52a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.405s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:04:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:04:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:04:16 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:04:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:16 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updating instance_info_cache with network_info: [{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG nova.compute.manager [req-8428b62c-d752-410e-93f8-8b0a1b7865ea req-c09275b2-2588-4605-9590-95ee885259fa service nova] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Received event network-vif-deleted-1a9af2dc-bef9-4a0f-993d-1b61022dda5d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209043.6392379, 682dbab8-ba72-4379-abaf-c35c9fff9d31 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:04:18 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] VM Stopped (Lifecycle Event)
Aug 16 18:04:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f4c9b2ee-ccc8-46da-b7d1-afe83dc61900 None None] [instance: 682dbab8-ba72-4379-abaf-c35c9fff9d31] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:04:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:20 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209045.7843575, 0e7d8582-d732-4344-9f10-97ef34e8a391 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:04:20 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] VM Stopped (Lifecycle Event)
Aug 16 18:04:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:04:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-62b30bca-fe3f-402a-b77c-88d18e9a53d2 None None] [instance: 0e7d8582-d732-4344-9f10-97ef34e8a391] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:21 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:04:21 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7540MB free_disk=23.986927032470703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a8532341-62b3-4c58-b3d8-db5440ad08c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance cef1b726-614c-4b75-8b44-5bc62f235424 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f5fc020a-3be1-4e78-8825-89f06406e945 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:04:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:04:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:26 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:04:26 user nova-compute[72000]: INFO nova.compute.claims [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Claim successful on node user
Aug 16 18:04:27 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:04:27 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:04:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:04:27 user nova-compute[72000]: INFO nova.virt.block_device [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Booting with volume ef07e040-562f-46e2-b532-6cc060f4931f at /dev/vda
Aug 16 18:04:27 user nova-compute[72000]: DEBUG os_brick.utils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d766f09-d07f-4ceb-9af5-e945041f7cdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af46e3-6091-4f3a-b385-1f8a673e405e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34ec736-e6d0-488b-8185-12fdc8e4598a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a924ede-862e-44ca-aa52-9cebed52e108]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:04:27 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:04:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[41522225-4c04-4076-a18e-8455c694b203]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG os_brick.utils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating existing volume attachment record: f7836983-4b70-434a-ab02-924c52da1dbb {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:04:27 user nova-compute[72000]: DEBUG nova.policy [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fbad49bffa64e649334499d2f3368e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de0840edb5e14cfd82ab75d5c09b8d21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:04:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:28 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209053.696018, 24b1035b-ae88-49a1-94f6-edc05ffce52a => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:04:28 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] VM Stopped (Lifecycle Event)
Aug 16 18:04:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-321fb390-74f9-4320-8cea-bb8c4df13fef None None] [instance: 24b1035b-ae88-49a1-94f6-edc05ffce52a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully created port: de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:04:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully created port: 06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:04:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully created port: 4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:04:30 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully created port: 92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:04:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully created port: 74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:04:31 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquired lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:04:31 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'info_cache' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updating instance_info_cache with network_info: [{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Releasing lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully updated port: de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:04:32 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance destroyed successfully.
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'resources' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-e88dc973-501c-47a6-ab60-ea3be8e419a4 req-95c8be03-3c3a-4236-9395-6371d5b095ac service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-changed-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-e88dc973-501c-47a6-ab60-ea3be8e419a4 req-95c8be03-3c3a-4236-9395-6371d5b095ac service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing instance network info cache due to event network-changed-de767d0a-0b30-40a6-9215-7e4f76277f78. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e88dc973-501c-47a6-ab60-ea3be8e419a4 req-95c8be03-3c3a-4236-9395-6371d5b095ac service nova] Acquiring lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e88dc973-501c-47a6-ab60-ea3be8e419a4 req-95c8be03-3c3a-4236-9395-6371d5b095ac service nova] Acquired lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.network.neutron [req-e88dc973-501c-47a6-ab60-ea3be8e419a4 req-95c8be03-3c3a-4236-9395-6371d5b095ac service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing network info cache for port de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1089625936',display_name='tempest-AttachVolumeTestJSON-server-1089625936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1089625936',id=5,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErb04qZpbsRut/09YXjqZYrtOHdBhP2tPvZwbKrovgBjHoU1dEbeqloQimLOszuW/qVazGtyEHJi8FlrHeWujg55/6v8atkLH5KmnvoByesgAKN67qz3UpqxjWpyoKkRQ==',key_name='tempest-keypair-622025030',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-gr5a7kt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_vif [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ac3c99f-65, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:04:32 user nova-compute[72000]: INFO os_vif [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65')
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myzoFxvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:32 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59b8fb5-f81d-4b5f-9615-1d947a73e178]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.network.neutron [req-e88dc973-501c-47a6-ab60-ea3be8e419a4 req-95c8be03-3c3a-4236-9395-6371d5b095ac service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdebb7f9-c5d3-4382-a40e-bfda26cbdf10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:32 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:32 user nova-compute[72000]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd019d34160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caf56cf-301b-4ee3-b949-4346b9fd6935]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cc3409-faa2-48d7-b417-cb90b93bd682]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c331d2-b924-4a0c-8501-c0f156bc1dcf]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7371b7f-014f-405f-910b-1ce51e34f202]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[100543d3-8dbc-44ad-96a7-614c46a3bbdc]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[653d6138-3af5-4b00-bffc-8fd2a6acb481]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260]
Aug 16 18:04:32 user nova-compute[72000]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260] successful.
Aug 16 18:04:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f626de-39c2-4a53-958d-4ab7a45d1787]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== disconnect_volume: return (296ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Start _get_guest_xml network_info=[{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myzoFxvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c', 'attached_at': '', 'detached_at': '', 'volume_id': '2b319930-55cc-4304-87b2-b1777b2fbe7d', 'serial': '2b319930-55cc-4304-87b2-b1777b2fbe7d'}, 'attachment_id': 'a92da204-e808-4ffd-9bab-7dd26e5e1476', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'numa_topology' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.network.neutron [req-e88dc973-501c-47a6-ab60-ea3be8e419a4 req-95c8be03-3c3a-4236-9395-6371d5b095ac service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:32 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:04:32 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e88dc973-501c-47a6-ab60-ea3be8e419a4 req-95c8be03-3c3a-4236-9395-6371d5b095ac service nova] Releasing lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myzoFxvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:32 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:04:32 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:04:32 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[953a8a53-eaf8-448e-90f1-99e7587a8228]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:04:32 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f54bca7-e0f5-4ea6-be7c-457569f4f2e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d] added
Aug 16 18:04:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8cee52-157b-41b3-b27a-50b0d7cc1af0]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[305c3410-23a8-42bb-9230-9dc86253c338]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v myzoFxvS {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v myzoFxvS" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c38535a-409f-486f-8921-64fae54d34fc]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'myzoFxvS'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[901480fa-bdd5-44c6-b84a-f7778dc95351]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f8660b-7681-4ca5-895a-133cbaebcf85]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:04:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb1f61f-f457-43bf-90db-0b4e4368012c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260]
Aug 16 18:04:33 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260] successful.
Aug 16 18:04:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d757fc-446c-41fb-b911-447bf88c5dd8]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ceb9ce-8084-45cb-9030-457676d7b20a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:33 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:33 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully updated port: 51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7281a5a-0cf7-4a0d-afab-db09f89423c3]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myzoFxvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:04:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully updated port: 7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26362383133663539', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362383133663539', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1089625936',display_name='tempest-AttachVolumeTestJSON-server-1089625936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1089625936',id=5,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErb04qZpbsRut/09YXjqZYrtOHdBhP2tPvZwbKrovgBjHoU1dEbeqloQimLOszuW/qVazGtyEHJi8FlrHeWujg55/6v8atkLH5KmnvoByesgAKN67qz3UpqxjWpyoKkRQ==',key_name='tempest-keypair-622025030',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-gr5a7kt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:04:34 user nova-compute[72000]:   <uuid>f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c</uuid>
Aug 16 18:04:34 user nova-compute[72000]:   <name>instance-00000005</name>
Aug 16 18:04:34 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:04:34 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:04:34 user nova-compute[72000]:   <metadata>
Aug 16 18:04:34 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:04:34 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:04:34 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeTestJSON-server-1089625936</nova:name>
Aug 16 18:04:34 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:04:32</nova:creationTime>
Aug 16 18:04:34 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:04:34 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:04:34 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:04:34 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:04:34 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:04:34 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:04:34 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:04:34 user nova-compute[72000]:       <nova:owner>
Aug 16 18:04:34 user nova-compute[72000]:         <nova:user uuid="6df288fb86024b8d8a10bb0d0049e499">tempest-AttachVolumeTestJSON-120427729-project-member</nova:user>
Aug 16 18:04:34 user nova-compute[72000]:         <nova:project uuid="fcae1940950a4007898ba8d8ca6de402">tempest-AttachVolumeTestJSON-120427729</nova:project>
Aug 16 18:04:34 user nova-compute[72000]:       </nova:owner>
Aug 16 18:04:34 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:04:34 user nova-compute[72000]:       <nova:ports>
Aug 16 18:04:34 user nova-compute[72000]:         <nova:port uuid="2ac3c99f-65bd-4aaa-899d-41ec43d44906">
Aug 16 18:04:34 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 18:04:34 user nova-compute[72000]:         </nova:port>
Aug 16 18:04:34 user nova-compute[72000]:       </nova:ports>
Aug 16 18:04:34 user nova-compute[72000]:     </nova:instance>
Aug 16 18:04:34 user nova-compute[72000]:   </metadata>
Aug 16 18:04:34 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:04:34 user nova-compute[72000]:     <system>
Aug 16 18:04:34 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:04:34 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:04:34 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:04:34 user nova-compute[72000]:       <entry name="serial">f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c</entry>
Aug 16 18:04:34 user nova-compute[72000]:       <entry name="uuid">f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c</entry>
Aug 16 18:04:34 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:04:34 user nova-compute[72000]:     </system>
Aug 16 18:04:34 user nova-compute[72000]:   </sysinfo>
Aug 16 18:04:34 user nova-compute[72000]:   <os>
Aug 16 18:04:34 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:04:34 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:04:34 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:04:34 user nova-compute[72000]:   </os>
Aug 16 18:04:34 user nova-compute[72000]:   <features>
Aug 16 18:04:34 user nova-compute[72000]:     <acpi/>
Aug 16 18:04:34 user nova-compute[72000]:     <apic/>
Aug 16 18:04:34 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:04:34 user nova-compute[72000]:   </features>
Aug 16 18:04:34 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:04:34 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:04:34 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:04:34 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:04:34 user nova-compute[72000]:   </clock>
Aug 16 18:04:34 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:04:34 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:04:34 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:04:34 user nova-compute[72000]:   </cpu>
Aug 16 18:04:34 user nova-compute[72000]:   <devices>
Aug 16 18:04:34 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:04:34 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:04:34 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk"/>
Aug 16 18:04:34 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:04:34 user nova-compute[72000]:     </disk>
Aug 16 18:04:34 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:04:34 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:04:34 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 18:04:34 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:04:34 user nova-compute[72000]:       <serial>2b319930-55cc-4304-87b2-b1777b2fbe7d</serial>
Aug 16 18:04:34 user nova-compute[72000]:     </disk>
Aug 16 18:04:34 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:04:34 user nova-compute[72000]:       <mac address="fa:16:3e:e1:0f:ec"/>
Aug 16 18:04:34 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:04:34 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:04:34 user nova-compute[72000]:       <target dev="tap2ac3c99f-65"/>
Aug 16 18:04:34 user nova-compute[72000]:     </interface>
Aug 16 18:04:34 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:04:34 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/console.log" append="off"/>
Aug 16 18:04:34 user nova-compute[72000]:     </serial>
Aug 16 18:04:34 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:04:34 user nova-compute[72000]:     <video>
Aug 16 18:04:34 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:04:34 user nova-compute[72000]:     </video>
Aug 16 18:04:34 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:04:34 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:04:34 user nova-compute[72000]:     </rng>
Aug 16 18:04:34 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:04:34 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:04:34 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:04:34 user nova-compute[72000]:     </memballoon>
Aug 16 18:04:34 user nova-compute[72000]:   </devices>
Aug 16 18:04:34 user nova-compute[72000]: </domain>
Aug 16 18:04:34 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-changed-51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing instance network info cache due to event network-changed-51aa08bd-5170-4234-8c91-07df0fa81bc5. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] Acquiring lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] Acquired lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing network info cache for port 51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:34 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:04:34 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:04:34 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08c62f1-38c0-40e6-afb8-1c73f9665e9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:04:34 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd4866f-cc4e-44da-8ca6-dd819c62cda8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa] added
Aug 16 18:04:34 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f50b510-c385-4ef4-9f74-f68ae9fa29ba]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'trusted_certs' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ece1b63-36eb-4233-8343-1a15c5874a2d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmFWTNRU {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully updated port: 06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmFWTNRU" returned: 0 in 0.056s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73004b4-711b-414c-9a76-2632dea0277b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kmFWTNRU'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbeed8d-c819-4c88-b15b-fc501177b6ef]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51e9ade-43cf-445f-9df7-1a74647033e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:34 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:34 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:34 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:34 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[363a0089-a108-448a-a5e1-ee5a2175ff4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]
Aug 16 18:04:34 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.
Aug 16 18:04:34 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3554a10c-b9dc-43d8-ba4e-a9b4f6091854]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa90503c-3cd3-4f4c-bac9-8c3ea9bf52e9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:34 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:34 user nova-compute[72000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:04:34 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:34 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:34 user nova-compute[72000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:04:34 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.228s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48e72da-d755-44c2-9950-6be5ead9bcf3]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] Releasing lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-changed-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing instance network info cache due to event network-changed-7e8000ae-52d9-4a24-ad5c-f6a80cca8210. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] Acquiring lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] Acquired lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing network info cache for port 7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Cannot resize image /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:04:34 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'migration_context' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1089625936',display_name='tempest-AttachVolumeTestJSON-server-1089625936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1089625936',id=5,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErb04qZpbsRut/09YXjqZYrtOHdBhP2tPvZwbKrovgBjHoU1dEbeqloQimLOszuW/qVazGtyEHJi8FlrHeWujg55/6v8atkLH5KmnvoByesgAKN67qz3UpqxjWpyoKkRQ==',key_name='tempest-keypair-622025030',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-gr5a7kt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG os_vif [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ac3c99f-65, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ac3c99f-65, col_values=(('external_ids', {'iface-id': '2ac3c99f-65bd-4aaa-899d-41ec43d44906', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:0f:ec', 'vm-uuid': 'f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:35 user nova-compute[72000]: INFO os_vif [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65')
Aug 16 18:04:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d9f33a5b-116a-423f-acb8-46155f96418e req-40f59711-97d3-4516-ba62-56ff1bd595ca service nova] Releasing lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully updated port: 4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23664623034313762', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664623034313762', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG nova.objects.instance [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'flavor' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:04:35 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:04:35 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:04:35 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:04:35 user nova-compute[72000]:   <serial>5a3bba8f-57f3-428b-87f7-c48a475f84fa</serial>
Aug 16 18:04:35 user nova-compute[72000]: </disk>
Aug 16 18:04:35 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-changed-06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing instance network info cache due to event network-changed-06896619-5181-4031-8206-fa030b712f6f. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] Acquiring lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] Acquired lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing network info cache for port 06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] No VIF found with MAC fa:16:3e:98:69:d9, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully updated port: 92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7a84e56d-f89d-4291-8986-022a5eea5dd4 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.268s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] Releasing lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-changed-4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing instance network info cache due to event network-changed-4054e387-560a-4992-b0e5-733ff789f2f1. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] Acquiring lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] Acquired lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG nova.network.neutron [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing network info cache for port 4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG nova.network.neutron [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-d656be52-0f27-4e88-8215-9017788271de req-f00951c8-25ae-4c5e-b9f5-75c1e3d41831 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d656be52-0f27-4e88-8215-9017788271de req-f00951c8-25ae-4c5e-b9f5-75c1e3d41831 service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d656be52-0f27-4e88-8215-9017788271de req-f00951c8-25ae-4c5e-b9f5-75c1e3d41831 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d656be52-0f27-4e88-8215-9017788271de req-f00951c8-25ae-4c5e-b9f5-75c1e3d41831 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-d656be52-0f27-4e88-8215-9017788271de req-f00951c8-25ae-4c5e-b9f5-75c1e3d41831 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:37 user nova-compute[72000]: WARNING nova.compute.manager [req-d656be52-0f27-4e88-8215-9017788271de req-f00951c8-25ae-4c5e-b9f5-75c1e3d41831 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state stopped and task_state powering-on.
Aug 16 18:04:37 user nova-compute[72000]: DEBUG nova.network.neutron [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f4e6baaf-e0db-4858-92bb-94286d5ca408 req-556adb5a-0218-40dd-953b-82c29ce88718 service nova] Releasing lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Successfully updated port: 74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquired lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:04:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:04:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-changed-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing instance network info cache due to event network-changed-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] Acquiring lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209079.4680426, f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:04:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] VM Resumed (Lifecycle Event)
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:04:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance rebooted successfully.
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f7baeb9f-c807-4ad0-84dc-4a0629aab055 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:04:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209079.470144, f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:04:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] VM Started (Lifecycle Event)
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-867b50de-f4c0-4332-b652-c976df6a68e0 req-316f8e6e-5d24-465e-b82e-defc4c589381 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-867b50de-f4c0-4332-b652-c976df6a68e0 req-316f8e6e-5d24-465e-b82e-defc4c589381 service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-867b50de-f4c0-4332-b652-c976df6a68e0 req-316f8e6e-5d24-465e-b82e-defc4c589381 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-867b50de-f4c0-4332-b652-c976df6a68e0 req-316f8e6e-5d24-465e-b82e-defc4c589381 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-867b50de-f4c0-4332-b652-c976df6a68e0 req-316f8e6e-5d24-465e-b82e-defc4c589381 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:39 user nova-compute[72000]: WARNING nova.compute.manager [req-867b50de-f4c0-4332-b652-c976df6a68e0 req-316f8e6e-5d24-465e-b82e-defc4c589381 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state stopped and task_state powering-on.
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Stashing vm_state: active {{(pid=72000) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'pci_requests' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:04:39 user nova-compute[72000]: INFO nova.compute.claims [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Claim successful on node user
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'resources' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'pci_devices' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:40 user nova-compute[72000]: INFO nova.compute.resource_tracker [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating resource usage from migration 03a9dd8d-4d9a-4244-b9fa-b8758ed333fd
Aug 16 18:04:40 user nova-compute[72000]: INFO nova.virt.block_device [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Booting with volume 74034cb7-6538-4acd-bfbc-8216ef5a81f0 at /dev/vdb
Aug 16 18:04:40 user nova-compute[72000]: DEBUG os_brick.utils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[77756e55-3e03-4948-b251-6543048c91ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c64ef-7453-45a2-bd04-efaa96900aad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.046s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c25689-1a3e-4781-b205-6d4df6e0b435]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b02f9a-87ee-440d-b544-7e8592f7e9b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:04:40 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac44f9b5-b9a2-4dde-a2a1-09f606c1431e]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG os_brick.utils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating existing volume attachment record: 0a1479b6-30d1-4f74-b717-2f3d6a0ad0d2 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.649s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:40 user nova-compute[72000]: INFO nova.compute.manager [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Migrating
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:40 user nova-compute[72000]: INFO nova.compute.rpcapi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquired lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG nova.network.neutron [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG nova.network.neutron [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [{"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Releasing lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Instance network_info: |[{"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] Acquired lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:40 user nova-compute[72000]: DEBUG nova.network.neutron [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing network info cache for port 92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updated VIF entry in instance network info cache for port 92e457e9-4656-4c5f-b1a4-dba3b27f7ac8. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [{"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] Releasing lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-changed-74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing instance network info cache due to event network-changed-74222f6d-fc28-4ae3-a554-d60f2dce0c57. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] Acquiring lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] Acquired lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing network info cache for port 74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG nova.network.neutron [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Releasing lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Starting migrate_disk_and_power_off {{(pid=72000) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updated VIF entry in instance network info cache for port 74222f6d-fc28-4ae3-a554-d60f2dce0c57. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [{"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-423cad76-032c-4691-8baa-2af7c884201f req-37bd00b3-aa20-4340-8d5b-9de3254a4fc6 service nova] Releasing lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-c6dda73b-5d20-445f-8e7a-e6bcfae24871 req-42e7f4dd-3cb5-48e7-bc34-c4fc85605157 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-unplugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c6dda73b-5d20-445f-8e7a-e6bcfae24871 req-42e7f4dd-3cb5-48e7-bc34-c4fc85605157 service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c6dda73b-5d20-445f-8e7a-e6bcfae24871 req-42e7f4dd-3cb5-48e7-bc34-c4fc85605157 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c6dda73b-5d20-445f-8e7a-e6bcfae24871 req-42e7f4dd-3cb5-48e7-bc34-c4fc85605157 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-c6dda73b-5d20-445f-8e7a-e6bcfae24871 req-42e7f4dd-3cb5-48e7-bc34-c4fc85605157 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-unplugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:42 user nova-compute[72000]: WARNING nova.compute.manager [req-c6dda73b-5d20-445f-8e7a-e6bcfae24871 req-42e7f4dd-3cb5-48e7-bc34-c4fc85605157 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-unplugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state active and task_state resize_migrating.
Aug 16 18:04:42 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance destroyed successfully.
Aug 16 18:04:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-158489387',display_name='tempest-ServerActionsTestOtherB-server-158489387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-158489387',id=4,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrdiqOjF0w82oTGC6W8NyzHji/AAi+fARuYFDptSsxWEW2f7mWefGKfWyQtISbWHzqnq0YFbbPnDR8XKw6XPCJva4Yjg8+O3HxmlUuJZCmEJf2X0VZ0VVhtvx/qeQ8XoQ==',key_name='tempest-keypair-1407087314',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df523a13c0914e4ea7c2782d10e6535c',ramdisk_id='',reservation_id='r-hdgm4kha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915732487',owner_user_name='tempest-ServerActionsTestOtherB-915732487-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb202933952474c99d17811058efc7c',uuid=a8532341-62b3-4c58-b3d8-db5440ad08c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-864425115-network", "vif_mac": "fa:16:3e:98:69:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converting VIF {"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-864425115-network", "vif_mac": "fa:16:3e:98:69:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_vif [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap548341b0-47, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:42 user nova-compute[72000]: INFO os_vif [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47')
Aug 16 18:04:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:42 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea92c68-4c9d-4e49-b6c2-76b36356ef09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37a4e51-931c-4e78-a645-b4e4d20e67a7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:42 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:42 user nova-compute[72000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:04:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:04:42 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:04:42 user nova-compute[72000]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:04:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd010240dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a344c5-4ac8-4519-977b-95a2ec22790e]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0120223c-398a-4009-89c7-5085d60dd743]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc83c1d8-95a7-48e9-9f82-6e059b8305e4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[757db554-040c-48b0-a7d2-fc2321b61820]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f752cdf-1dbf-45c1-9dc8-54e8b3d0cccf]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25cc1e8-89fb-48da-b4d1-34207cd0a034]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]
Aug 16 18:04:42 user nova-compute[72000]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.
Aug 16 18:04:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9abecc-0fc4-44e8-afa7-e5ce6db3969c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] <== disconnect_volume: return (310ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:04:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3_resize/disk /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "cp -r /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3_resize/disk /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk" returned: 0 in 0.387s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3_resize/disk.info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk.info {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "cp -r /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3_resize/disk.info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk.info" returned: 0 in 0.032s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-5a936e21-34b8-4b2e-b2bb-b0f9814bea96 req-de37da94-199b-4c89-bcf4-28e92006fc6f service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:04:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5a936e21-34b8-4b2e-b2bb-b0f9814bea96 req-de37da94-199b-4c89-bcf4-28e92006fc6f service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5a936e21-34b8-4b2e-b2bb-b0f9814bea96 req-de37da94-199b-4c89-bcf4-28e92006fc6f service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5a936e21-34b8-4b2e-b2bb-b0f9814bea96 req-de37da94-199b-4c89-bcf4-28e92006fc6f service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-5a936e21-34b8-4b2e-b2bb-b0f9814bea96 req-de37da94-199b-4c89-bcf4-28e92006fc6f service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:04:44 user nova-compute[72000]: WARNING nova.compute.manager [req-5a936e21-34b8-4b2e-b2bb-b0f9814bea96 req-de37da94-199b-4c89-bcf4-28e92006fc6f service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state active and task_state resize_migrating.
Aug 16 18:04:45 user nova-compute[72000]: DEBUG nova.network.neutron [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Port 548341b0-47da-4962-b21a-fd4cc4118bdc binding to destination host user is already ACTIVE {{(pid=72000) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 18:04:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:04:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquired lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:04:45 user nova-compute[72000]: DEBUG nova.network.neutron [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:04:46 user nova-compute[72000]: DEBUG nova.network.neutron [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:04:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Releasing lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG os_brick.utils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc4d7cb-2a53-4acf-b8f3-e34ad6a470f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8d70f1-2c95-48ed-ae1d-97e211a8609b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42b189c-8e2e-4a7d-b4f3-e1b0f27986b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa18cd4-de71-4bee-90c5-6d3a7e6340dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:04:47 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:04:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[897b08b1-8064-4758-8002-d88bec974fca]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG os_brick.utils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:52 user nova-compute[72000]: INFO nova.virt.block_device [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Booting with volume 2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 at /dev/vdc
Aug 16 18:04:52 user nova-compute[72000]: DEBUG os_brick.utils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d29f9e6-1439-4f8e-b352-600236ad6d1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae6dd2-ac0b-4a8d-b86b-eefe02b1081d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[518ab4ff-8d88-4d59-b774-73a38115b454]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1089bc02-fc2a-4fc5-aea7-54361bba0fcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:04:52 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:04:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb7dff3-abe6-4d18-94a1-1b4a90e4c1b6]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG os_brick.utils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:04:52 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating existing volume attachment record: f5eb8833-681f-4620-87ec-58048324f491 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:04:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:57 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209082.4746485, a8532341-62b3-4c58-b3d8-db5440ad08c3 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:04:57 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] VM Stopped (Lifecycle Event)
Aug 16 18:04:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-38e8caf2-2aa4-4dca-b40b-b81ef30a9ac2 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:04:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-38e8caf2-2aa4-4dca-b40b-b81ef30a9ac2 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:04:57 user nova-compute[72000]: INFO nova.compute.manager [None req-38e8caf2-2aa4-4dca-b40b-b81ef30a9ac2 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 18:04:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Starting finish_migration {{(pid=72000) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance directory exists: not creating {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 18:04:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Creating image(s)
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.objects.instance [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'trusted_certs' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk. size=21474836480 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:04:59 user nova-compute[72000]: INFO nova.compute.claims [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Claim successful on node user
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk 21474836480 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk 21474836480" returned: 0 in 0.062s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Ensure instance console log exists: /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Start _get_guest_xml network_info=[{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-864425115-network", "vif_mac": "fa:16:3e:98:69:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a8532341-62b3-4c58-b3d8-db5440ad08c3', 'attached_at': '2023-08-16T18:04:59.000000', 'detached_at': '', 'volume_id': '5a3bba8f-57f3-428b-87f7-c48a475f84fa', 'serial': '5a3bba8f-57f3-428b-87f7-c48a475f84fa'}, 'attachment_id': 'd2a26482-c898-4f7b-8773-fad6784e1f84', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:04:59 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:04:59 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.objects.instance [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:04:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:04:59 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:00 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:00 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[303dfb46-f382-4d40-882d-2e7d60f6d029]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:05:00 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f2cddd-7e27-4e8e-9b2f-d6eb6be1ba0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa] added
Aug 16 18:05:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e28ae2e-eda8-41b5-8fda-66c22096f821]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cbcb41-d6e7-48ed-baf2-6e21d08b77eb]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmFWTNRU {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmFWTNRU" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d094fc-25ee-4527-b6f2-46c9521ea376]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kmFWTNRU'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba926d6d-c4ce-461c-9785-bd32ccf60c01]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d16f6a-8938-4b33-bb16-62e84d17f8cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:00 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:00 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2b972b-0a9f-4b58-a830-12c978ee2e59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]
Aug 16 18:05:00 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.
Aug 16 18:05:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bfa621-e240-4e3d-ba48-2808b5b184e1]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af9c0b9-4d1b-4b7b-ba14-f5548886fb21]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:00 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:00 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:00 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:00 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90615de1-50d5-47a0-a86b-95ceb64b8ec1]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "966d4480-7413-43bc-9b0f-6a522e88908b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.795s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:05:00 user nova-compute[72000]: INFO nova.compute.claims [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Claim successful on node user
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:05:00 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.policy [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd07d329987884ac98b87374ca2074b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5442ba2319584631a81b2d1208b5f65f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:05:00 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Creating image(s)
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.264s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:05:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.232s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk 1073741824" returned: 0 in 0.080s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23664623034313762', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664623034313762', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Successfully created port: cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-158489387',display_name='tempest-ServerActionsTestOtherB-server-158489387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-158489387',id=4,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrdiqOjF0w82oTGC6W8NyzHji/AAi+fARuYFDptSsxWEW2f7mWefGKfWyQtISbWHzqnq0YFbbPnDR8XKw6XPCJva4Yjg8+O3HxmlUuJZCmEJf2X0VZ0VVhtvx/qeQ8XoQ==',key_name='tempest-keypair-1407087314',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df523a13c0914e4ea7c2782d10e6535c',ramdisk_id='',reservation_id='r-hdgm4kha',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915732487',owner_user_name='tempest-ServerActionsTestOtherB-915732487-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb202933952474c99d17811058efc7c',uuid=a8532341-62b3-4c58-b3d8-db5440ad08c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-864425115-network", "vif_mac": "fa:16:3e:98:69:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converting VIF {"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-864425115-network", "vif_mac": "fa:16:3e:98:69:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:05:01 user nova-compute[72000]:   <uuid>a8532341-62b3-4c58-b3d8-db5440ad08c3</uuid>
Aug 16 18:05:01 user nova-compute[72000]:   <name>instance-00000004</name>
Aug 16 18:05:01 user nova-compute[72000]:   <memory>2097152</memory>
Aug 16 18:05:01 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:05:01 user nova-compute[72000]:   <metadata>
Aug 16 18:05:01 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:05:01 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:05:01 user nova-compute[72000]:       <nova:name>tempest-ServerActionsTestOtherB-server-158489387</nova:name>
Aug 16 18:05:01 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:04:59</nova:creationTime>
Aug 16 18:05:01 user nova-compute[72000]:       <nova:flavor name="m1.small">
Aug 16 18:05:01 user nova-compute[72000]:         <nova:memory>2048</nova:memory>
Aug 16 18:05:01 user nova-compute[72000]:         <nova:disk>20</nova:disk>
Aug 16 18:05:01 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:05:01 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:05:01 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:05:01 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:05:01 user nova-compute[72000]:       <nova:owner>
Aug 16 18:05:01 user nova-compute[72000]:         <nova:user uuid="4bb202933952474c99d17811058efc7c">tempest-ServerActionsTestOtherB-915732487-project-member</nova:user>
Aug 16 18:05:01 user nova-compute[72000]:         <nova:project uuid="df523a13c0914e4ea7c2782d10e6535c">tempest-ServerActionsTestOtherB-915732487</nova:project>
Aug 16 18:05:01 user nova-compute[72000]:       </nova:owner>
Aug 16 18:05:01 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:05:01 user nova-compute[72000]:       <nova:ports>
Aug 16 18:05:01 user nova-compute[72000]:         <nova:port uuid="548341b0-47da-4962-b21a-fd4cc4118bdc">
Aug 16 18:05:01 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 18:05:01 user nova-compute[72000]:         </nova:port>
Aug 16 18:05:01 user nova-compute[72000]:       </nova:ports>
Aug 16 18:05:01 user nova-compute[72000]:     </nova:instance>
Aug 16 18:05:01 user nova-compute[72000]:   </metadata>
Aug 16 18:05:01 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:05:01 user nova-compute[72000]:     <system>
Aug 16 18:05:01 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:05:01 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:05:01 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:05:01 user nova-compute[72000]:       <entry name="serial">a8532341-62b3-4c58-b3d8-db5440ad08c3</entry>
Aug 16 18:05:01 user nova-compute[72000]:       <entry name="uuid">a8532341-62b3-4c58-b3d8-db5440ad08c3</entry>
Aug 16 18:05:01 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:05:01 user nova-compute[72000]:     </system>
Aug 16 18:05:01 user nova-compute[72000]:   </sysinfo>
Aug 16 18:05:01 user nova-compute[72000]:   <os>
Aug 16 18:05:01 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:05:01 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:05:01 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:05:01 user nova-compute[72000]:   </os>
Aug 16 18:05:01 user nova-compute[72000]:   <features>
Aug 16 18:05:01 user nova-compute[72000]:     <acpi/>
Aug 16 18:05:01 user nova-compute[72000]:     <apic/>
Aug 16 18:05:01 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:05:01 user nova-compute[72000]:   </features>
Aug 16 18:05:01 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:05:01 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:05:01 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:05:01 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:05:01 user nova-compute[72000]:   </clock>
Aug 16 18:05:01 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:05:01 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:05:01 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:05:01 user nova-compute[72000]:   </cpu>
Aug 16 18:05:01 user nova-compute[72000]:   <devices>
Aug 16 18:05:01 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:05:01 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:05:01 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk"/>
Aug 16 18:05:01 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:05:01 user nova-compute[72000]:     </disk>
Aug 16 18:05:01 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:05:01 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:05:01 user nova-compute[72000]:       <source dev="/dev/sdc"/>
Aug 16 18:05:01 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:05:01 user nova-compute[72000]:       <serial>5a3bba8f-57f3-428b-87f7-c48a475f84fa</serial>
Aug 16 18:05:01 user nova-compute[72000]:     </disk>
Aug 16 18:05:01 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:05:01 user nova-compute[72000]:       <mac address="fa:16:3e:98:69:d9"/>
Aug 16 18:05:01 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:01 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:05:01 user nova-compute[72000]:       <target dev="tap548341b0-47"/>
Aug 16 18:05:01 user nova-compute[72000]:     </interface>
Aug 16 18:05:01 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:05:01 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/console.log" append="off"/>
Aug 16 18:05:01 user nova-compute[72000]:     </serial>
Aug 16 18:05:01 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:05:01 user nova-compute[72000]:     <video>
Aug 16 18:05:01 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:01 user nova-compute[72000]:     </video>
Aug 16 18:05:01 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:05:01 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:05:01 user nova-compute[72000]:     </rng>
Aug 16 18:05:01 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:05:01 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:05:01 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:05:01 user nova-compute[72000]:     </memballoon>
Aug 16 18:05:01 user nova-compute[72000]:   </devices>
Aug 16 18:05:01 user nova-compute[72000]: </domain>
Aug 16 18:05:01 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-158489387',display_name='tempest-ServerActionsTestOtherB-server-158489387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-158489387',id=4,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrdiqOjF0w82oTGC6W8NyzHji/AAi+fARuYFDptSsxWEW2f7mWefGKfWyQtISbWHzqnq0YFbbPnDR8XKw6XPCJva4Yjg8+O3HxmlUuJZCmEJf2X0VZ0VVhtvx/qeQ8XoQ==',key_name='tempest-keypair-1407087314',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df523a13c0914e4ea7c2782d10e6535c',ramdisk_id='',reservation_id='r-hdgm4kha',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915732487',owner_user_name='tempest-ServerActionsTestOtherB-915732487-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb202933952474c99d17811058efc7c',uuid=a8532341-62b3-4c58-b3d8-db5440ad08c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-864425115-network", "vif_mac": "fa:16:3e:98:69:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converting VIF {"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-864425115-network", "vif_mac": "fa:16:3e:98:69:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG os_vif [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap548341b0-47, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap548341b0-47, col_values=(('external_ids', {'iface-id': '548341b0-47da-4962-b21a-fd4cc4118bdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:69:d9', 'vm-uuid': 'a8532341-62b3-4c58-b3d8-db5440ad08c3'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:01 user nova-compute[72000]: INFO os_vif [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47')
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:05:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Creating image(s)
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.250s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.policy [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd07d329987884ac98b87374ca2074b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5442ba2319584631a81b2d1208b5f65f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] No VIF found with MAC fa:16:3e:98:69:d9, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Cannot resize image /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'migration_context' on Instance uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.261s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Ensure instance console log exists: /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk 1073741824" returned: 0 in 0.050s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Successfully created port: f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Cannot resize image /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.objects.instance [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'migration_context' on Instance uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Ensure instance console log exists: /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Successfully updated port: cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquired lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-be57837e-979b-4e23-82f7-290a951cbe13 req-7e1ea961-f135-4c46-b496-0a727208be21 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-changed-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-be57837e-979b-4e23-82f7-290a951cbe13 req-7e1ea961-f135-4c46-b496-0a727208be21 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Refreshing instance network info cache due to event network-changed-cb091dac-a7ef-4da6-a4c3-b0e1977f7350. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-be57837e-979b-4e23-82f7-290a951cbe13 req-7e1ea961-f135-4c46-b496-0a727208be21 service nova] Acquiring lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updating instance_info_cache with network_info: [{"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Releasing lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Instance network_info: |[{"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-be57837e-979b-4e23-82f7-290a951cbe13 req-7e1ea961-f135-4c46-b496-0a727208be21 service nova] Acquired lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-be57837e-979b-4e23-82f7-290a951cbe13 req-7e1ea961-f135-4c46-b496-0a727208be21 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Refreshing network info cache for port cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Start _get_guest_xml network_info=[{"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:05:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1571244693',display_name='tempest-ServerRescueNegativeTestJSON-server-1571244693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1571244693',id=16,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-pxsrqr84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:05:01Z,user_data=None,user_id='d07d329987884ac98b87374ca2074b86',uuid=4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=cb091dac-a7ef-4da6-a4c3-b0e1977f7350,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb091dac-a7') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:05:03 user nova-compute[72000]:   <uuid>4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716</uuid>
Aug 16 18:05:03 user nova-compute[72000]:   <name>instance-00000010</name>
Aug 16 18:05:03 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:05:03 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:05:03 user nova-compute[72000]:   <metadata>
Aug 16 18:05:03 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:05:03 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:05:03 user nova-compute[72000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1571244693</nova:name>
Aug 16 18:05:03 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:05:03</nova:creationTime>
Aug 16 18:05:03 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:05:03 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:05:03 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:05:03 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:05:03 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:05:03 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:05:03 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:05:03 user nova-compute[72000]:       <nova:owner>
Aug 16 18:05:03 user nova-compute[72000]:         <nova:user uuid="d07d329987884ac98b87374ca2074b86">tempest-ServerRescueNegativeTestJSON-1605720785-project-member</nova:user>
Aug 16 18:05:03 user nova-compute[72000]:         <nova:project uuid="5442ba2319584631a81b2d1208b5f65f">tempest-ServerRescueNegativeTestJSON-1605720785</nova:project>
Aug 16 18:05:03 user nova-compute[72000]:       </nova:owner>
Aug 16 18:05:03 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:05:03 user nova-compute[72000]:       <nova:ports>
Aug 16 18:05:03 user nova-compute[72000]:         <nova:port uuid="cb091dac-a7ef-4da6-a4c3-b0e1977f7350">
Aug 16 18:05:03 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:05:03 user nova-compute[72000]:         </nova:port>
Aug 16 18:05:03 user nova-compute[72000]:       </nova:ports>
Aug 16 18:05:03 user nova-compute[72000]:     </nova:instance>
Aug 16 18:05:03 user nova-compute[72000]:   </metadata>
Aug 16 18:05:03 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:05:03 user nova-compute[72000]:     <system>
Aug 16 18:05:03 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:05:03 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:05:03 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:05:03 user nova-compute[72000]:       <entry name="serial">4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716</entry>
Aug 16 18:05:03 user nova-compute[72000]:       <entry name="uuid">4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716</entry>
Aug 16 18:05:03 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:05:03 user nova-compute[72000]:     </system>
Aug 16 18:05:03 user nova-compute[72000]:   </sysinfo>
Aug 16 18:05:03 user nova-compute[72000]:   <os>
Aug 16 18:05:03 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:05:03 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:05:03 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:05:03 user nova-compute[72000]:   </os>
Aug 16 18:05:03 user nova-compute[72000]:   <features>
Aug 16 18:05:03 user nova-compute[72000]:     <acpi/>
Aug 16 18:05:03 user nova-compute[72000]:     <apic/>
Aug 16 18:05:03 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:05:03 user nova-compute[72000]:   </features>
Aug 16 18:05:03 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:05:03 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:05:03 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:05:03 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:05:03 user nova-compute[72000]:   </clock>
Aug 16 18:05:03 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:05:03 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:05:03 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:05:03 user nova-compute[72000]:   </cpu>
Aug 16 18:05:03 user nova-compute[72000]:   <devices>
Aug 16 18:05:03 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:05:03 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:05:03 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk"/>
Aug 16 18:05:03 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:05:03 user nova-compute[72000]:     </disk>
Aug 16 18:05:03 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:05:03 user nova-compute[72000]:       <mac address="fa:16:3e:0b:57:ff"/>
Aug 16 18:05:03 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:03 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:05:03 user nova-compute[72000]:       <target dev="tapcb091dac-a7"/>
Aug 16 18:05:03 user nova-compute[72000]:     </interface>
Aug 16 18:05:03 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:05:03 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/console.log" append="off"/>
Aug 16 18:05:03 user nova-compute[72000]:     </serial>
Aug 16 18:05:03 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:05:03 user nova-compute[72000]:     <video>
Aug 16 18:05:03 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:03 user nova-compute[72000]:     </video>
Aug 16 18:05:03 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:05:03 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:05:03 user nova-compute[72000]:     </rng>
Aug 16 18:05:03 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:05:03 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:05:03 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:05:03 user nova-compute[72000]:     </memballoon>
Aug 16 18:05:03 user nova-compute[72000]:   </devices>
Aug 16 18:05:03 user nova-compute[72000]: </domain>
Aug 16 18:05:03 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1571244693',display_name='tempest-ServerRescueNegativeTestJSON-server-1571244693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1571244693',id=16,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-pxsrqr84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:05:01Z,user_data=None,user_id='d07d329987884ac98b87374ca2074b86',uuid=4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=cb091dac-a7ef-4da6-a4c3-b0e1977f7350,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb091dac-a7') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG os_vif [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=cb091dac-a7ef-4da6-a4c3-b0e1977f7350,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb091dac-a7') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb091dac-a7, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb091dac-a7, col_values=(('external_ids', {'iface-id': 'cb091dac-a7ef-4da6-a4c3-b0e1977f7350', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:57:ff', 'vm-uuid': '4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: INFO os_vif [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=cb091dac-a7ef-4da6-a4c3-b0e1977f7350,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb091dac-a7')
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No VIF found with MAC fa:16:3e:0b:57:ff, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:03 user nova-compute[72000]: INFO nova.compute.manager [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Terminating instance
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Successfully updated port: f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquired lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-98bde60a-1ea4-4687-8842-6e1789039b8a req-8aa2fc36-6d39-436b-84db-91a181f0b887 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-changed-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-98bde60a-1ea4-4687-8842-6e1789039b8a req-8aa2fc36-6d39-436b-84db-91a181f0b887 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Refreshing instance network info cache due to event network-changed-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-98bde60a-1ea4-4687-8842-6e1789039b8a req-8aa2fc36-6d39-436b-84db-91a181f0b887 service nova] Acquiring lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.network.neutron [req-be57837e-979b-4e23-82f7-290a951cbe13 req-7e1ea961-f135-4c46-b496-0a727208be21 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updated VIF entry in instance network info cache for port cb091dac-a7ef-4da6-a4c3-b0e1977f7350. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.network.neutron [req-be57837e-979b-4e23-82f7-290a951cbe13 req-7e1ea961-f135-4c46-b496-0a727208be21 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updating instance_info_cache with network_info: [{"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-be57837e-979b-4e23-82f7-290a951cbe13 req-7e1ea961-f135-4c46-b496-0a727208be21 service nova] Releasing lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Updating instance_info_cache with network_info: [{"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Releasing lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Instance network_info: |[{"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-98bde60a-1ea4-4687-8842-6e1789039b8a req-8aa2fc36-6d39-436b-84db-91a181f0b887 service nova] Acquired lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.network.neutron [req-98bde60a-1ea4-4687-8842-6e1789039b8a req-8aa2fc36-6d39-436b-84db-91a181f0b887 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Refreshing network info cache for port f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Start _get_guest_xml network_info=[{"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:05:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:05:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-698649144',display_name='tempest-ServerRescueNegativeTestJSON-server-698649144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-698649144',id=17,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-oj515vfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:05:01Z,user_data=None,user_id='d07d329987884ac98b87374ca2074b86',uuid=966d4480-7413-43bc-9b0f-6a522e88908b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f8881b-d1') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.objects.instance [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'pci_devices' on Instance uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:05:04 user nova-compute[72000]:   <uuid>966d4480-7413-43bc-9b0f-6a522e88908b</uuid>
Aug 16 18:05:04 user nova-compute[72000]:   <name>instance-00000011</name>
Aug 16 18:05:04 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:05:04 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:05:04 user nova-compute[72000]:   <metadata>
Aug 16 18:05:04 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:05:04 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:05:04 user nova-compute[72000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-698649144</nova:name>
Aug 16 18:05:04 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:05:04</nova:creationTime>
Aug 16 18:05:04 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:05:04 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:05:04 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:05:04 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:05:04 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:05:04 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:05:04 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:05:04 user nova-compute[72000]:       <nova:owner>
Aug 16 18:05:04 user nova-compute[72000]:         <nova:user uuid="d07d329987884ac98b87374ca2074b86">tempest-ServerRescueNegativeTestJSON-1605720785-project-member</nova:user>
Aug 16 18:05:04 user nova-compute[72000]:         <nova:project uuid="5442ba2319584631a81b2d1208b5f65f">tempest-ServerRescueNegativeTestJSON-1605720785</nova:project>
Aug 16 18:05:04 user nova-compute[72000]:       </nova:owner>
Aug 16 18:05:04 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:05:04 user nova-compute[72000]:       <nova:ports>
Aug 16 18:05:04 user nova-compute[72000]:         <nova:port uuid="f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf">
Aug 16 18:05:04 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 18:05:04 user nova-compute[72000]:         </nova:port>
Aug 16 18:05:04 user nova-compute[72000]:       </nova:ports>
Aug 16 18:05:04 user nova-compute[72000]:     </nova:instance>
Aug 16 18:05:04 user nova-compute[72000]:   </metadata>
Aug 16 18:05:04 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:05:04 user nova-compute[72000]:     <system>
Aug 16 18:05:04 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:05:04 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:05:04 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:05:04 user nova-compute[72000]:       <entry name="serial">966d4480-7413-43bc-9b0f-6a522e88908b</entry>
Aug 16 18:05:04 user nova-compute[72000]:       <entry name="uuid">966d4480-7413-43bc-9b0f-6a522e88908b</entry>
Aug 16 18:05:04 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:05:04 user nova-compute[72000]:     </system>
Aug 16 18:05:04 user nova-compute[72000]:   </sysinfo>
Aug 16 18:05:04 user nova-compute[72000]:   <os>
Aug 16 18:05:04 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:05:04 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:05:04 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:05:04 user nova-compute[72000]:   </os>
Aug 16 18:05:04 user nova-compute[72000]:   <features>
Aug 16 18:05:04 user nova-compute[72000]:     <acpi/>
Aug 16 18:05:04 user nova-compute[72000]:     <apic/>
Aug 16 18:05:04 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:05:04 user nova-compute[72000]:   </features>
Aug 16 18:05:04 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:05:04 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:05:04 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:05:04 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:05:04 user nova-compute[72000]:   </clock>
Aug 16 18:05:04 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:05:04 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:05:04 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:05:04 user nova-compute[72000]:   </cpu>
Aug 16 18:05:04 user nova-compute[72000]:   <devices>
Aug 16 18:05:04 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:05:04 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:05:04 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk"/>
Aug 16 18:05:04 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:05:04 user nova-compute[72000]:     </disk>
Aug 16 18:05:04 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:05:04 user nova-compute[72000]:       <mac address="fa:16:3e:18:cd:11"/>
Aug 16 18:05:04 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:04 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:05:04 user nova-compute[72000]:       <target dev="tapf6f8881b-d1"/>
Aug 16 18:05:04 user nova-compute[72000]:     </interface>
Aug 16 18:05:04 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:05:04 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/console.log" append="off"/>
Aug 16 18:05:04 user nova-compute[72000]:     </serial>
Aug 16 18:05:04 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:05:04 user nova-compute[72000]:     <video>
Aug 16 18:05:04 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:04 user nova-compute[72000]:     </video>
Aug 16 18:05:04 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:05:04 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:05:04 user nova-compute[72000]:     </rng>
Aug 16 18:05:04 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:05:04 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:05:04 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:05:04 user nova-compute[72000]:     </memballoon>
Aug 16 18:05:04 user nova-compute[72000]:   </devices>
Aug 16 18:05:04 user nova-compute[72000]: </domain>
Aug 16 18:05:04 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-698649144',display_name='tempest-ServerRescueNegativeTestJSON-server-698649144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-698649144',id=17,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-oj515vfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:05:01Z,user_data=None,user_id='d07d329987884ac98b87374ca2074b86',uuid=966d4480-7413-43bc-9b0f-6a522e88908b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f8881b-d1') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG os_vif [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f8881b-d1') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6f8881b-d1, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6f8881b-d1, col_values=(('external_ids', {'iface-id': 'f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:cd:11', 'vm-uuid': '966d4480-7413-43bc-9b0f-6a522e88908b'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:04 user nova-compute[72000]: INFO os_vif [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f8881b-d1')
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:05:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No VIF found with MAC fa:16:3e:18:cd:11, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-8d33a497-6b61-49aa-8776-ecd142879df1 req-fcf72927-e6db-4847-8e25-3c7e747db3b8 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received event network-changed-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-8d33a497-6b61-49aa-8776-ecd142879df1 req-fcf72927-e6db-4847-8e25-3c7e747db3b8 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Refreshing instance network info cache due to event network-changed-0f4c186b-25e4-4a47-a54e-d58d0abf66fa. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8d33a497-6b61-49aa-8776-ecd142879df1 req-fcf72927-e6db-4847-8e25-3c7e747db3b8 service nova] Acquiring lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8d33a497-6b61-49aa-8776-ecd142879df1 req-fcf72927-e6db-4847-8e25-3c7e747db3b8 service nova] Acquired lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.network.neutron [req-8d33a497-6b61-49aa-8776-ecd142879df1 req-fcf72927-e6db-4847-8e25-3c7e747db3b8 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Refreshing network info cache for port 0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:05:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Instance destroyed successfully.
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.objects.instance [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lazy-loading 'resources' on Instance uuid cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1630113568',display_name='tempest-TestVolumeSwap-server-1630113568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1630113568',id=10,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOXnbCRoL7d1Ai6REwXMAziqaCCFXlhYo2bhCp3RsgVQjFRQdJB5ewmjq9ggftUq8kuSmdpBVsLZdbgqnJcGAuaeccLM4dsdiw5CiChQYin2GMsI6zz2vzEJNfVwDbibQ==',key_name='tempest-keypair-1153245667',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:01:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9ad8e66da964d339b229c1a74f94e4e',ramdisk_id='',reservation_id='r-mdny771q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-364823705',owner_user_name='tempest-TestVolumeSwap-364823705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:01:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed0e92bcc29a4b699e55670cd593fbcc',uuid=cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Converting VIF {"id": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "address": "fa:16:3e:aa:05:61", "network": {"id": "1b89f99d-2e82-4169-a9b0-e57f460c61f5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-508995579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9ad8e66da964d339b229c1a74f94e4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c92204c-43", "ovs_interfaceid": "0c92204c-43a6-4966-8a04-b04fdc1b1b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:05:61,bridge_name='br-int',has_traffic_filtering=True,id=0c92204c-43a6-4966-8a04-b04fdc1b1b3a,network=Network(1b89f99d-2e82-4169-a9b0-e57f460c61f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c92204c-43') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG os_vif [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:05:61,bridge_name='br-int',has_traffic_filtering=True,id=0c92204c-43a6-4966-8a04-b04fdc1b1b3a,network=Network(1b89f99d-2e82-4169-a9b0-e57f460c61f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c92204c-43') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c92204c-43, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:05 user nova-compute[72000]: INFO os_vif [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:05:61,bridge_name='br-int',has_traffic_filtering=True,id=0c92204c-43a6-4966-8a04-b04fdc1b1b3a,network=Network(1b89f99d-2e82-4169-a9b0-e57f460c61f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c92204c-43')
Aug 16 18:05:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Deleting instance files /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6_del
Aug 16 18:05:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Deletion of /opt/stack/data/nova/instances/cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6_del complete
Aug 16 18:05:05 user nova-compute[72000]: INFO nova.compute.manager [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Took 1.80 seconds to destroy the instance on the hypervisor.
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.network.neutron [req-98bde60a-1ea4-4687-8842-6e1789039b8a req-8aa2fc36-6d39-436b-84db-91a181f0b887 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Updated VIF entry in instance network info cache for port f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.network.neutron [req-98bde60a-1ea4-4687-8842-6e1789039b8a req-8aa2fc36-6d39-436b-84db-91a181f0b887 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Updating instance_info_cache with network_info: [{"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:05 user nova-compute[72000]: WARNING nova.compute.manager [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state active and task_state resize_finish.
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:05 user nova-compute[72000]: WARNING nova.compute.manager [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state active and task_state resize_finish.
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received event network-vif-unplugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] No waiting events found dispatching network-vif-unplugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-dcddbe33-9333-4a6b-8a77-8fe226db7935 req-3eea3e8c-ea8c-465b-9dfa-3da7b93a778b service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received event network-vif-unplugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-98bde60a-1ea4-4687-8842-6e1789039b8a req-8aa2fc36-6d39-436b-84db-91a181f0b887 service nova] Releasing lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:05:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Creating image(s)
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Ensure instance console log exists: /opt/stack/data/nova/instances/b22234a2-c9cb-4a04-856c-ef718c80e59d/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Start _get_guest_xml network_info=[{"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVSABnsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b22234a2-c9cb-4a04-856c-ef718c80e59d', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef07e040-562f-46e2-b532-6cc060f4931f', 'serial': 'ef07e040-562f-46e2-b532-6cc060f4931f'}, 'attachment_id': 'f7836983-4b70-434a-ab02-924c52da1dbb', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amOYTADj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b22234a2-c9cb-4a04-856c-ef718c80e59d', 'attached_at': '', 'detached_at': '', 'volume_id': '74034cb7-6538-4acd-bfbc-8216ef5a81f0', 'serial': '74034cb7-6538-4acd-bfbc-8216ef5a81f0'}, 'attachment_id': '0a1479b6-30d1-4f74-b717-2f3d6a0ad0d2', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMpNlqcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b22234a2-c9cb-4a04-856c-ef718c80e59d', 'attached_at': '', 'detached_at': '', 'volume_id': '2eff1de9-c635-4d52-b81b-4ee9ab1b4e83', 'serial': '2eff1de9-c635-4d52-b81b-4ee9ab1b4e83'}, 'attachment_id': 'f5eb8833-681f-4620-87ec-58048324f491', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.network.neutron [req-8d33a497-6b61-49aa-8776-ecd142879df1 req-fcf72927-e6db-4847-8e25-3c7e747db3b8 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updated VIF entry in instance network info cache for port 0f4c186b-25e4-4a47-a54e-d58d0abf66fa. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.network.neutron [req-8d33a497-6b61-49aa-8776-ecd142879df1 req-fcf72927-e6db-4847-8e25-3c7e747db3b8 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updating instance_info_cache with network_info: [{"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'flavor' on Instance uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:06 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:05:06 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8d33a497-6b61-49aa-8776-ecd142879df1 req-fcf72927-e6db-4847-8e25-3c7e747db3b8 service nova] Releasing lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.175s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVSABnsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:05:06 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:06 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:06 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3742302-f09e-4461-8b17-9e162d740c3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:05:06 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1a458d-d1ee-4b5f-b569-f2d777e4eeb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f] added
Aug 16 18:05:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0929c470-392e-477a-b73b-399b148e1c38]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[991b6f6a-596d-43b7-9e1f-b62c33fcaed4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVSABnsf {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVSABnsf" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5054bca-0d7a-49b3-b9a6-9a365d441df4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CVSABnsf'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:06 user nova-compute[72000]: INFO nova.compute.manager [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Attaching volume eee7f526-7ef4-4562-83e5-567b5edf70f6 to /dev/vdb
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c7451f-c2e3-42d6-9c0c-7368c774ad46]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[429ca1fb-4958-453a-9fbb-ce03ccca4106]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:06 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:06 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:06 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:06 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.utils [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[765758f1-b63d-406e-8a42-5b2ddbefaa63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcfa6c5-35ef-47a2-b2f6-62e7d748869a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33cd618-8630-4c04-a2a5-286a1981f15b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f, portal: 172.16.0.220,3260]
Aug 16 18:05:06 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f, portal: 172.16.0.220,3260] successful.
Aug 16 18:05:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2170ee-6866-4540-8c12-c806c9584e22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32260f1-49a3-41d7-9595-c26cefa8b64a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af32ac-e28f-4418-b0f8-15fe3d2d4886]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:05:06 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92785f9-6099-496c-84ad-f8465323c0f3]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fce518-67db-448f-9aa1-0cdbd6df5852]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:06 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:06 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:06 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:06 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:06 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:06 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.454s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.utils [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updating existing volume attachment record: b93e8395-433b-4257-89fd-4240e26d0011 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ef66dd-4654-4496-a5d9-c4c4a66309c8]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVSABnsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209106.9105484, a8532341-62b3-4c58-b3d8-db5440ad08c3 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:06 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] VM Resumed (Lifecycle Event)
Aug 16 18:05:06 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Took 1.58 seconds to deallocate network for instance.
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance running successfully.
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Failed to set time: agent not configured {{(pid=72000) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-02fe810a-d8b7-45d6-89a2-490cb5b00e57 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] finish_migration finished successfully. {{(pid=72000) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:05:06 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 18:05:06 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209106.9157372, a8532341-62b3-4c58-b3d8-db5440ad08c3 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:06 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] VM Started (Lifecycle Event)
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-a73200a6-cf87-4bd8-a404-b916849a21cb req-95cf52d4-73ab-4671-bb13-dbb3166d2b52 service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received event network-vif-deleted-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '26236313837386635', 'path': '/dev/sde'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236313837386635', 'path': '/dev/sde'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amOYTADj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:05:07 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:07 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:07 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe03fcd-05ef-45e3-872c-6617c9449400]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:05:07 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a859c14-6316-4ccd-8d4e-af07b2a51b91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0] added
Aug 16 18:05:07 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c03c69-63bc-4f7b-b3a4-e82196d7eed2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received event network-vif-plugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] Acquiring lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] No waiting events found dispatching network-vif-plugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:07 user nova-compute[72000]: WARNING nova.compute.manager [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Received unexpected event network-vif-plugged-0c92204c-43a6-4966-8a04-b04fdc1b1b3a for instance with vm_state deleted and task_state None.
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:07 user nova-compute[72000]: WARNING nova.compute.manager [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state building and task_state spawning.
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:07 user nova-compute[72000]: WARNING nova.compute.manager [req-403cdae7-1a32-4210-87e5-3103fa24dac2 req-889899c5-5292-40bf-957f-df1043b205ab service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state building and task_state spawning.
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5972a66f-5fa6-4da9-b7e7-930acb1e9c7e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amOYTADj {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.955s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amOYTADj" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6ab2a8-6bfe-4f8b-9102-66c41d54efdf]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'amOYTADj'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa993bb-c4b4-4c8a-8dd6-623fc8d24be2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:08 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Deleted allocations for instance cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f853a2-21e1-4675-a50d-261ab1e5adc9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6047ba5f-8413-434a-b987-98fb6051873a tempest-TestVolumeSwap-364823705 tempest-TestVolumeSwap-364823705-project-member] Lock "cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.620s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c4a764-3e26-4bf4-9576-6ccf232f90a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0, portal: 172.16.0.220,3260]
Aug 16 18:05:08 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0, portal: 172.16.0.220,3260] successful.
Aug 16 18:05:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d161ac-30d8-4ef9-9fac-93633dc03505]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f313e12-5c77-42fc-ba81-b35ffc3564bc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:08 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.043s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5446470b-af51-467b-997c-f01c7269586b]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:05:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amOYTADj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] No waiting events found dispatching network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:09 user nova-compute[72000]: WARNING nova.compute.manager [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received unexpected event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf for instance with vm_state building and task_state spawning.
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] No waiting events found dispatching network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:09 user nova-compute[72000]: WARNING nova.compute.manager [req-6e559d6f-3b7a-46b4-a66f-e10dbae65f2a req-a85d8f52-a1af-4a26-b6dc-7114519ac9bf service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received unexpected event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf for instance with vm_state building and task_state spawning.
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '23332613966393262', 'path': '/dev/sdf'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332613966393262', 'path': '/dev/sdf'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMpNlqcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:05:09 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:09 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:09 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ea5aec-d5e3-4c5f-8baa-5f698e1a83bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:05:09 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0072ce98-ddcc-4716-b924-7823c9c6f78b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83] added
Aug 16 18:05:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[040fc643-ec7d-49ff-9b5b-5f5d64b40f79]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6df3831-1c68-441a-b3df-59d4fd96f858]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMpNlqcE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMpNlqcE" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e1f579-a440-4a41-b587-a50afbd67d56]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMpNlqcE'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b7fa38-b38e-4a31-b3fa-d155cd6b5bd2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac8364-b3e6-4893-8516-ac2995112906]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209109.58004, 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] VM Resumed (Lifecycle Event)
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Instance spawned successfully.
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Instance spawned successfully.
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbafe4b6-fad5-4dea-a865-3aa5664cd6e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83, portal: 172.16.0.220,3260]
Aug 16 18:05:09 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83, portal: 172.16.0.220,3260] successful.
Aug 16 18:05:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[321a5db7-1471-46ee-9667-320882618af4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209109.5803483, 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] VM Started (Lifecycle Event)
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcb1cd7-3196-42a0-a58b-52e8d82beb34]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:09 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:09 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.compute.manager [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Took 8.25 seconds to spawn the instance on the hypervisor.
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.036s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cab5f2-f822-45e1-851f-ee32bf0414b7]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMpNlqcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.compute.manager [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Took 9.06 seconds to spawn the instance on the hypervisor.
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209109.5813715, 966d4480-7413-43bc-9b0f-6a522e88908b => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] VM Resumed (Lifecycle Event)
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.compute.manager [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Took 10.30 seconds to build instance.
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:05:09 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209109.5824034, 966d4480-7413-43bc-9b0f-6a522e88908b => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] VM Started (Lifecycle Event)
Aug 16 18:05:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff2a6728-8030-467e-946d-e0a60580bc24 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.425s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:10 user nova-compute[72000]: INFO nova.compute.manager [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Took 9.49 seconds to build instance.
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4de1143-b833-4aea-9d4e-05270aabb788 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "966d4480-7413-43bc-9b0f-6a522e88908b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.629s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23730363034663732', 'path': '/dev/sdg'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730363034663732', 'path': '/dev/sdg'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:a1,bridge_name='br-int',has_traffic_filtering=True,id=de767d0a-0b30-40a6-9215-7e4f76277f78,network=Network(9b257c2f-c837-4feb-a93c-d098b6fb8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde767d0a-0b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:77,bridge_name='br-int',has_traffic_filtering=True,id=51aa08bd-5170-4234-8c91-07df0fa81bc5,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51aa08bd-51') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:67:a2,bridge_name='br-int',has_traffic_filtering=True,id=7e8000ae-52d9-4a24-ad5c-f6a80cca8210,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8000ae-52') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:99,bridge_name='br-int',has_traffic_filtering=True,id=06896619-5181-4031-8206-fa030b712f6f,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06896619-51') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:17:72,bridge_name='br-int',has_traffic_filtering=True,id=4054e387-560a-4992-b0e5-733ff789f2f1,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4054e387-56') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:19:3a,bridge_name='br-int',has_traffic_filtering=True,id=92e457e9-4656-4c5f-b1a4-dba3b27f7ac8,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e457e9-46') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f2:67,bridge_name='br-int',has_traffic_filtering=True,id=74222f6d-fc28-4ae3-a554-d60f2dce0c57,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74222f6d-fc') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lazy-loading 'pci_devices' on Instance uuid b22234a2-c9cb-4a04-856c-ef718c80e59d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:05:10 user nova-compute[72000]:   <uuid>b22234a2-c9cb-4a04-856c-ef718c80e59d</uuid>
Aug 16 18:05:10 user nova-compute[72000]:   <name>instance-0000000f</name>
Aug 16 18:05:10 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:05:10 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:05:10 user nova-compute[72000]:   <metadata>
Aug 16 18:05:10 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:05:10 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:05:10 user nova-compute[72000]:       <nova:name>tempest-device-tagging-server-192007662</nova:name>
Aug 16 18:05:10 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:05:06</nova:creationTime>
Aug 16 18:05:10 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:05:10 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:05:10 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:05:10 user nova-compute[72000]:       <nova:owner>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:user uuid="3fbad49bffa64e649334499d2f3368e4">tempest-TaggedBootDevicesTest_v242-1668389145-project-member</nova:user>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:project uuid="de0840edb5e14cfd82ab75d5c09b8d21">tempest-TaggedBootDevicesTest_v242-1668389145</nova:project>
Aug 16 18:05:10 user nova-compute[72000]:       </nova:owner>
Aug 16 18:05:10 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:05:10 user nova-compute[72000]:       <nova:ports>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:port uuid="de767d0a-0b30-40a6-9215-7e4f76277f78">
Aug 16 18:05:10 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 18:05:10 user nova-compute[72000]:         </nova:port>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:port uuid="51aa08bd-5170-4234-8c91-07df0fa81bc5">
Aug 16 18:05:10 user nova-compute[72000]:           <nova:ip type="fixed" address="10.1.1.114" ipVersion="4"/>
Aug 16 18:05:10 user nova-compute[72000]:         </nova:port>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:port uuid="7e8000ae-52d9-4a24-ad5c-f6a80cca8210">
Aug 16 18:05:10 user nova-compute[72000]:           <nova:ip type="fixed" address="10.1.1.80" ipVersion="4"/>
Aug 16 18:05:10 user nova-compute[72000]:         </nova:port>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:port uuid="06896619-5181-4031-8206-fa030b712f6f">
Aug 16 18:05:10 user nova-compute[72000]:           <nova:ip type="fixed" address="10.1.1.16" ipVersion="4"/>
Aug 16 18:05:10 user nova-compute[72000]:         </nova:port>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:port uuid="4054e387-560a-4992-b0e5-733ff789f2f1">
Aug 16 18:05:10 user nova-compute[72000]:           <nova:ip type="fixed" address="10.1.1.218" ipVersion="4"/>
Aug 16 18:05:10 user nova-compute[72000]:         </nova:port>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:port uuid="92e457e9-4656-4c5f-b1a4-dba3b27f7ac8">
Aug 16 18:05:10 user nova-compute[72000]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 18:05:10 user nova-compute[72000]:         </nova:port>
Aug 16 18:05:10 user nova-compute[72000]:         <nova:port uuid="74222f6d-fc28-4ae3-a554-d60f2dce0c57">
Aug 16 18:05:10 user nova-compute[72000]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 18:05:10 user nova-compute[72000]:         </nova:port>
Aug 16 18:05:10 user nova-compute[72000]:       </nova:ports>
Aug 16 18:05:10 user nova-compute[72000]:     </nova:instance>
Aug 16 18:05:10 user nova-compute[72000]:   </metadata>
Aug 16 18:05:10 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:05:10 user nova-compute[72000]:     <system>
Aug 16 18:05:10 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:05:10 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:05:10 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:05:10 user nova-compute[72000]:       <entry name="serial">b22234a2-c9cb-4a04-856c-ef718c80e59d</entry>
Aug 16 18:05:10 user nova-compute[72000]:       <entry name="uuid">b22234a2-c9cb-4a04-856c-ef718c80e59d</entry>
Aug 16 18:05:10 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:05:10 user nova-compute[72000]:     </system>
Aug 16 18:05:10 user nova-compute[72000]:   </sysinfo>
Aug 16 18:05:10 user nova-compute[72000]:   <os>
Aug 16 18:05:10 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:05:10 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:05:10 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:05:10 user nova-compute[72000]:   </os>
Aug 16 18:05:10 user nova-compute[72000]:   <features>
Aug 16 18:05:10 user nova-compute[72000]:     <acpi/>
Aug 16 18:05:10 user nova-compute[72000]:     <apic/>
Aug 16 18:05:10 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:05:10 user nova-compute[72000]:   </features>
Aug 16 18:05:10 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:05:10 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:05:10 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:05:10 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:05:10 user nova-compute[72000]:   </clock>
Aug 16 18:05:10 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:05:10 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:05:10 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:05:10 user nova-compute[72000]:   </cpu>
Aug 16 18:05:10 user nova-compute[72000]:   <devices>
Aug 16 18:05:10 user nova-compute[72000]:     <disk type="file" device="cdrom">
Aug 16 18:05:10 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 18:05:10 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/b22234a2-c9cb-4a04-856c-ef718c80e59d/disk.config"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="hda" bus="ide"/>
Aug 16 18:05:10 user nova-compute[72000]:     </disk>
Aug 16 18:05:10 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:05:10 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:05:10 user nova-compute[72000]:       <source dev="/dev/sde"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:       <serial>ef07e040-562f-46e2-b532-6cc060f4931f</serial>
Aug 16 18:05:10 user nova-compute[72000]:     </disk>
Aug 16 18:05:10 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:05:10 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:05:10 user nova-compute[72000]:       <source dev="/dev/sdf"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:       <serial>74034cb7-6538-4acd-bfbc-8216ef5a81f0</serial>
Aug 16 18:05:10 user nova-compute[72000]:     </disk>
Aug 16 18:05:10 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:05:10 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:05:10 user nova-compute[72000]:       <source dev="/dev/sdg"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="vdc" bus="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:       <serial>2eff1de9-c635-4d52-b81b-4ee9ab1b4e83</serial>
Aug 16 18:05:10 user nova-compute[72000]:     </disk>
Aug 16 18:05:10 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:05:10 user nova-compute[72000]:       <mac address="fa:16:3e:2b:ea:a1"/>
Aug 16 18:05:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="tapde767d0a-0b"/>
Aug 16 18:05:10 user nova-compute[72000]:     </interface>
Aug 16 18:05:10 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:05:10 user nova-compute[72000]:       <mac address="fa:16:3e:7e:b0:77"/>
Aug 16 18:05:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="tap51aa08bd-51"/>
Aug 16 18:05:10 user nova-compute[72000]:     </interface>
Aug 16 18:05:10 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:05:10 user nova-compute[72000]:       <mac address="fa:16:3e:4c:67:a2"/>
Aug 16 18:05:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="tap7e8000ae-52"/>
Aug 16 18:05:10 user nova-compute[72000]:     </interface>
Aug 16 18:05:10 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:05:10 user nova-compute[72000]:       <mac address="fa:16:3e:81:35:99"/>
Aug 16 18:05:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="tap06896619-51"/>
Aug 16 18:05:10 user nova-compute[72000]:     </interface>
Aug 16 18:05:10 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:05:10 user nova-compute[72000]:       <mac address="fa:16:3e:bf:17:72"/>
Aug 16 18:05:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="tap4054e387-56"/>
Aug 16 18:05:10 user nova-compute[72000]:     </interface>
Aug 16 18:05:10 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:05:10 user nova-compute[72000]:       <mac address="fa:16:3e:f1:19:3a"/>
Aug 16 18:05:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="tap92e457e9-46"/>
Aug 16 18:05:10 user nova-compute[72000]:     </interface>
Aug 16 18:05:10 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:05:10 user nova-compute[72000]:       <mac address="fa:16:3e:f6:f2:67"/>
Aug 16 18:05:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:05:10 user nova-compute[72000]:       <target dev="tap74222f6d-fc"/>
Aug 16 18:05:10 user nova-compute[72000]:     </interface>
Aug 16 18:05:10 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:05:10 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/b22234a2-c9cb-4a04-856c-ef718c80e59d/console.log" append="off"/>
Aug 16 18:05:10 user nova-compute[72000]:     </serial>
Aug 16 18:05:10 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:05:10 user nova-compute[72000]:     <video>
Aug 16 18:05:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:05:10 user nova-compute[72000]:     </video>
Aug 16 18:05:10 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:05:10 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:05:10 user nova-compute[72000]:     </rng>
Aug 16 18:05:10 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:05:10 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:05:10 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:05:10 user nova-compute[72000]:     </memballoon>
Aug 16 18:05:10 user nova-compute[72000]:   </devices>
Aug 16 18:05:10 user nova-compute[72000]: </domain>
Aug 16 18:05:10 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:a1,bridge_name='br-int',has_traffic_filtering=True,id=de767d0a-0b30-40a6-9215-7e4f76277f78,network=Network(9b257c2f-c837-4feb-a93c-d098b6fb8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde767d0a-0b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:a1,bridge_name='br-int',has_traffic_filtering=True,id=de767d0a-0b30-40a6-9215-7e4f76277f78,network=Network(9b257c2f-c837-4feb-a93c-d098b6fb8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde767d0a-0b') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde767d0a-0b, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde767d0a-0b, col_values=(('external_ids', {'iface-id': 'de767d0a-0b30-40a6-9215-7e4f76277f78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:ea:a1', 'vm-uuid': 'b22234a2-c9cb-4a04-856c-ef718c80e59d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:10 user nova-compute[72000]: INFO os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ea:a1,bridge_name='br-int',has_traffic_filtering=True,id=de767d0a-0b30-40a6-9215-7e4f76277f78,network=Network(9b257c2f-c837-4feb-a93c-d098b6fb8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde767d0a-0b')
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:77,bridge_name='br-int',has_traffic_filtering=True,id=51aa08bd-5170-4234-8c91-07df0fa81bc5,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51aa08bd-51') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:77,bridge_name='br-int',has_traffic_filtering=True,id=51aa08bd-5170-4234-8c91-07df0fa81bc5,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51aa08bd-51') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51aa08bd-51, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51aa08bd-51, col_values=(('external_ids', {'iface-id': '51aa08bd-5170-4234-8c91-07df0fa81bc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:b0:77', 'vm-uuid': 'b22234a2-c9cb-4a04-856c-ef718c80e59d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:10 user nova-compute[72000]: INFO os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:77,bridge_name='br-int',has_traffic_filtering=True,id=51aa08bd-5170-4234-8c91-07df0fa81bc5,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51aa08bd-51')
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:05:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:67:a2,bridge_name='br-int',has_traffic_filtering=True,id=7e8000ae-52d9-4a24-ad5c-f6a80cca8210,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8000ae-52') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:67:a2,bridge_name='br-int',has_traffic_filtering=True,id=7e8000ae-52d9-4a24-ad5c-f6a80cca8210,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8000ae-52') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e8000ae-52, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e8000ae-52, col_values=(('external_ids', {'iface-id': '7e8000ae-52d9-4a24-ad5c-f6a80cca8210', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:67:a2', 'vm-uuid': 'b22234a2-c9cb-4a04-856c-ef718c80e59d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: INFO os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:67:a2,bridge_name='br-int',has_traffic_filtering=True,id=7e8000ae-52d9-4a24-ad5c-f6a80cca8210,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8000ae-52')
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:99,bridge_name='br-int',has_traffic_filtering=True,id=06896619-5181-4031-8206-fa030b712f6f,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06896619-51') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:99,bridge_name='br-int',has_traffic_filtering=True,id=06896619-5181-4031-8206-fa030b712f6f,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06896619-51') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06896619-51, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06896619-51, col_values=(('external_ids', {'iface-id': '06896619-5181-4031-8206-fa030b712f6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:35:99', 'vm-uuid': 'b22234a2-c9cb-4a04-856c-ef718c80e59d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: INFO os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:99,bridge_name='br-int',has_traffic_filtering=True,id=06896619-5181-4031-8206-fa030b712f6f,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06896619-51')
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:17:72,bridge_name='br-int',has_traffic_filtering=True,id=4054e387-560a-4992-b0e5-733ff789f2f1,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4054e387-56') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:17:72,bridge_name='br-int',has_traffic_filtering=True,id=4054e387-560a-4992-b0e5-733ff789f2f1,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4054e387-56') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4054e387-56, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4054e387-56, col_values=(('external_ids', {'iface-id': '4054e387-560a-4992-b0e5-733ff789f2f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:17:72', 'vm-uuid': 'b22234a2-c9cb-4a04-856c-ef718c80e59d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: INFO os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:17:72,bridge_name='br-int',has_traffic_filtering=True,id=4054e387-560a-4992-b0e5-733ff789f2f1,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4054e387-56')
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:19:3a,bridge_name='br-int',has_traffic_filtering=True,id=92e457e9-4656-4c5f-b1a4-dba3b27f7ac8,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e457e9-46') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:19:3a,bridge_name='br-int',has_traffic_filtering=True,id=92e457e9-4656-4c5f-b1a4-dba3b27f7ac8,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e457e9-46') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92e457e9-46, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92e457e9-46, col_values=(('external_ids', {'iface-id': '92e457e9-4656-4c5f-b1a4-dba3b27f7ac8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:19:3a', 'vm-uuid': 'b22234a2-c9cb-4a04-856c-ef718c80e59d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: INFO os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:19:3a,bridge_name='br-int',has_traffic_filtering=True,id=92e457e9-4656-4c5f-b1a4-dba3b27f7ac8,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e457e9-46')
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:04:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f2:67,bridge_name='br-int',has_traffic_filtering=True,id=74222f6d-fc28-4ae3-a554-d60f2dce0c57,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74222f6d-fc') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f2:67,bridge_name='br-int',has_traffic_filtering=True,id=74222f6d-fc28-4ae3-a554-d60f2dce0c57,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74222f6d-fc') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74222f6d-fc, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74222f6d-fc, col_values=(('external_ids', {'iface-id': '74222f6d-fc28-4ae3-a554-d60f2dce0c57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:f2:67', 'vm-uuid': 'b22234a2-c9cb-4a04-856c-ef718c80e59d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:11 user nova-compute[72000]: INFO os_vif [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f2:67,bridge_name='br-int',has_traffic_filtering=True,id=74222f6d-fc28-4ae3-a554-d60f2dce0c57,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74222f6d-fc')
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] No BDM found with device name hda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] No VIF found with MAC fa:16:3e:2b:ea:a1, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] No VIF found with MAC fa:16:3e:bf:17:72, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:05:11 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Using config drive
Aug 16 18:05:11 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Creating config drive at /opt/stack/data/nova/instances/b22234a2-c9cb-4a04-856c-ef718c80e59d/disk.config
Aug 16 18:05:11 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b22234a2-c9cb-4a04-856c-ef718c80e59d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf3cpwzij {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:11 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b22234a2-c9cb-4a04-856c-ef718c80e59d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf3cpwzij" returned: 0 in 0.090s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-00a2d6e3-f09a-4d9e-8a9e-2297a1f7d6bc req-4b3a11f2-f6dd-48e7-9020-b6192f5b660b service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-00a2d6e3-f09a-4d9e-8a9e-2297a1f7d6bc req-4b3a11f2-f6dd-48e7-9020-b6192f5b660b service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-00a2d6e3-f09a-4d9e-8a9e-2297a1f7d6bc req-4b3a11f2-f6dd-48e7-9020-b6192f5b660b service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.017s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-00a2d6e3-f09a-4d9e-8a9e-2297a1f7d6bc req-4b3a11f2-f6dd-48e7-9020-b6192f5b660b service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-00a2d6e3-f09a-4d9e-8a9e-2297a1f7d6bc req-4b3a11f2-f6dd-48e7-9020-b6192f5b660b service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:13 user nova-compute[72000]: WARNING nova.compute.manager [req-00a2d6e3-f09a-4d9e-8a9e-2297a1f7d6bc req-4b3a11f2-f6dd-48e7-9020-b6192f5b660b service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-de767d0a-0b30-40a6-9215-7e4f76277f78 for instance with vm_state building and task_state spawning.
Aug 16 18:05:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-ffe533c3-1459-4abb-afbf-fc787f5c1d70 req-2d4ff577-1bc6-4e88-8eee-a31fe1d7b703 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ffe533c3-1459-4abb-afbf-fc787f5c1d70 req-2d4ff577-1bc6-4e88-8eee-a31fe1d7b703 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ffe533c3-1459-4abb-afbf-fc787f5c1d70 req-2d4ff577-1bc6-4e88-8eee-a31fe1d7b703 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ffe533c3-1459-4abb-afbf-fc787f5c1d70 req-2d4ff577-1bc6-4e88-8eee-a31fe1d7b703 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-ffe533c3-1459-4abb-afbf-fc787f5c1d70 req-2d4ff577-1bc6-4e88-8eee-a31fe1d7b703 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:14 user nova-compute[72000]: WARNING nova.compute.manager [req-ffe533c3-1459-4abb-afbf-fc787f5c1d70 req-2d4ff577-1bc6-4e88-8eee-a31fe1d7b703 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 for instance with vm_state building and task_state spawning.
Aug 16 18:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.018s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:16 user nova-compute[72000]: WARNING nova.compute.manager [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-de767d0a-0b30-40a6-9215-7e4f76277f78 for instance with vm_state building and task_state spawning.
Aug 16 18:05:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:16 user nova-compute[72000]: WARNING nova.compute.manager [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-06896619-5181-4031-8206-fa030b712f6f for instance with vm_state building and task_state spawning.
Aug 16 18:05:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:16 user nova-compute[72000]: WARNING nova.compute.manager [req-3d9a933a-624d-479f-b35f-193c59e55edc req-72540dbc-741f-4b91-93f6-3a1856f88ff5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-06896619-5181-4031-8206-fa030b712f6f for instance with vm_state building and task_state spawning.
Aug 16 18:05:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ad75fa3-04e6-4c2b-aa83-996245431e8a req-000a1b0c-e4a7-483b-b3f6-c873c47ee925 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ad75fa3-04e6-4c2b-aa83-996245431e8a req-000a1b0c-e4a7-483b-b3f6-c873c47ee925 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ad75fa3-04e6-4c2b-aa83-996245431e8a req-000a1b0c-e4a7-483b-b3f6-c873c47ee925 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ad75fa3-04e6-4c2b-aa83-996245431e8a req-000a1b0c-e4a7-483b-b3f6-c873c47ee925 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ad75fa3-04e6-4c2b-aa83-996245431e8a req-000a1b0c-e4a7-483b-b3f6-c873c47ee925 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:16 user nova-compute[72000]: WARNING nova.compute.manager [req-1ad75fa3-04e6-4c2b-aa83-996245431e8a req-000a1b0c-e4a7-483b-b3f6-c873c47ee925 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 for instance with vm_state building and task_state spawning.
Aug 16 18:05:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-d23745c9-b445-4288-aca9-936ac8057c35 req-521c68c2-9b5d-407f-bb98-b9b859a21b64 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d23745c9-b445-4288-aca9-936ac8057c35 req-521c68c2-9b5d-407f-bb98-b9b859a21b64 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d23745c9-b445-4288-aca9-936ac8057c35 req-521c68c2-9b5d-407f-bb98-b9b859a21b64 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d23745c9-b445-4288-aca9-936ac8057c35 req-521c68c2-9b5d-407f-bb98-b9b859a21b64 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-d23745c9-b445-4288-aca9-936ac8057c35 req-521c68c2-9b5d-407f-bb98-b9b859a21b64 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:16 user nova-compute[72000]: WARNING nova.compute.manager [req-d23745c9-b445-4288-aca9-936ac8057c35 req-521c68c2-9b5d-407f-bb98-b9b859a21b64 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 for instance with vm_state building and task_state spawning.
Aug 16 18:05:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:18 user nova-compute[72000]: WARNING nova.compute.manager [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-4054e387-560a-4992-b0e5-733ff789f2f1 for instance with vm_state building and task_state spawning.
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:18 user nova-compute[72000]: WARNING nova.compute.manager [req-abfe9ebe-136e-432c-9a3d-e09ea7a95b08 req-e8075f3b-fe97-4aba-bb77-a8215fca3ab5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-4054e387-560a-4992-b0e5-733ff789f2f1 for instance with vm_state building and task_state spawning.
Aug 16 18:05:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-6105a3b2-e4f5-45d1-8762-5ce6b307a630 req-6ef00590-206f-454d-be5f-1f17eb5ea2d4 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6105a3b2-e4f5-45d1-8762-5ce6b307a630 req-6ef00590-206f-454d-be5f-1f17eb5ea2d4 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6105a3b2-e4f5-45d1-8762-5ce6b307a630 req-6ef00590-206f-454d-be5f-1f17eb5ea2d4 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6105a3b2-e4f5-45d1-8762-5ce6b307a630 req-6ef00590-206f-454d-be5f-1f17eb5ea2d4 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-6105a3b2-e4f5-45d1-8762-5ce6b307a630 req-6ef00590-206f-454d-be5f-1f17eb5ea2d4 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:18 user nova-compute[72000]: WARNING nova.compute.manager [req-6105a3b2-e4f5-45d1-8762-5ce6b307a630 req-6ef00590-206f-454d-be5f-1f17eb5ea2d4 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 for instance with vm_state building and task_state spawning.
Aug 16 18:05:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:18 user nova-compute[72000]: WARNING nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 for instance with vm_state building and task_state spawning.
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:18 user nova-compute[72000]: WARNING nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 for instance with vm_state building and task_state spawning.
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:18 user nova-compute[72000]: WARNING nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 for instance with vm_state building and task_state spawning.
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:18 user nova-compute[72000]: WARNING nova.compute.manager [req-fbd015cb-6ac5-4fa6-8b55-dd487a3baa01 req-2199adf6-0f67-431a-9bfb-59accff34e78 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 for instance with vm_state building and task_state spawning.
Aug 16 18:05:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209118.9009697, b22234a2-c9cb-4a04-856c-ef718c80e59d => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:18 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] VM Resumed (Lifecycle Event)
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:05:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Instance spawned successfully.
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:05:18 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:05:18 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209118.9011643, b22234a2-c9cb-4a04-856c-ef718c80e59d => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:18 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] VM Started (Lifecycle Event)
Aug 16 18:05:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:05:19 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:05:19 user nova-compute[72000]: INFO nova.compute.manager [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Took 13.03 seconds to spawn the instance on the hypervisor.
Aug 16 18:05:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:19 user nova-compute[72000]: INFO nova.compute.manager [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Took 52.51 seconds to build instance.
Aug 16 18:05:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c302dc4c-53fc-4c45-a14d-4826aa82c7e0 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.660s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:20 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209105.1641552, cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:20 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] VM Stopped (Lifecycle Event)
Aug 16 18:05:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-573d23dc-02e4-42c2-bcc7-40e6a6a28cae None None] [instance: cbcb4dfb-249b-4ee7-9779-cc7dec0b1af6] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:05:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:05:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOiDNCLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:05:22 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:22 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:22 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f17fd8-fd88-4b9e-a4ea-8cb65e8f0041]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:05:22 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9506e5d6-bbe2-449b-b2db-3bdf919e2058]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6] added
Aug 16 18:05:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72229f5d-bb7d-4af8-a516-5571b874a239]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c9cf02-9a3e-4ace-b873-b61cd82da806]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOiDNCLM {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOiDNCLM" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d914a29-20f0-4b21-83b4-d644367fa9ae]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QOiDNCLM'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4435b-27a0-4f7a-be42-b9ff34d727b6]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fe3022-f54e-4691-84d7-035b5ce3aa5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6c835e-8835-42a7-ad68-246b22b21674]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6, portal: 172.16.0.220,3260]
Aug 16 18:05:22 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6, portal: 172.16.0.220,3260] successful.
Aug 16 18:05:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b7aae3-e45d-4be5-a9bd-b1a633256a38]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c2ce6e-2da5-4784-ac8c-0cf28700de4e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 (non-flash)
Aug 16 18:05:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f0eccf-8ab5-43cf-9f70-38509caf5bd5]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOiDNCLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:05:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Updating instance_info_cache with network_info: [{"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.523s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== connect_volume: return (1524ms) {'type': 'block', 'scsi_wwn': '23931313234326566', 'path': '/dev/sdh'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931313234326566', 'path': '/dev/sdh'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG nova.objects.instance [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'flavor' on Instance uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:05:23 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:05:23 user nova-compute[72000]:   <source dev="/dev/sdh"/>
Aug 16 18:05:23 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:05:23 user nova-compute[72000]:   <serial>eee7f526-7ef4-4562-83e5-567b5edf70f6</serial>
Aug 16 18:05:23 user nova-compute[72000]: </disk>
Aug 16 18:05:23 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:05:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No VIF found with MAC fa:16:3e:77:34:1d, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b671de6d-2577-422e-a660-66c0b1d56064 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.031s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:26 user nova-compute[72000]: INFO nova.compute.manager [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Rebuilding instance
Aug 16 18:05:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG nova.objects.instance [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'trusted_certs' on Instance uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG nova.objects.instance [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'pci_requests' on Instance uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG nova.objects.instance [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'pci_devices' on Instance uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG nova.objects.instance [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'resources' on Instance uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG nova.objects.instance [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'migration_context' on Instance uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG nova.objects.instance [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72000) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG nova.compute.manager [req-96db0db3-37d3-4303-9769-c827c1aee9b8 req-b1906109-7c4c-4659-bede-a90277f70ec0 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received event network-vif-unplugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-96db0db3-37d3-4303-9769-c827c1aee9b8 req-b1906109-7c4c-4659-bede-a90277f70ec0 service nova] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-96db0db3-37d3-4303-9769-c827c1aee9b8 req-b1906109-7c4c-4659-bede-a90277f70ec0 service nova] Lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-96db0db3-37d3-4303-9769-c827c1aee9b8 req-b1906109-7c4c-4659-bede-a90277f70ec0 service nova] Lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG nova.compute.manager [req-96db0db3-37d3-4303-9769-c827c1aee9b8 req-b1906109-7c4c-4659-bede-a90277f70ec0 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] No waiting events found dispatching network-vif-unplugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:27 user nova-compute[72000]: WARNING nova.compute.manager [req-96db0db3-37d3-4303-9769-c827c1aee9b8 req-b1906109-7c4c-4659-bede-a90277f70ec0 service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received unexpected event network-vif-unplugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa for instance with vm_state active and task_state rebuilding.
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:05:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:27 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Instance destroyed successfully.
Aug 16 18:05:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:28 user nova-compute[72000]: INFO nova.compute.manager [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Detaching volume eee7f526-7ef4-4562-83e5-567b5edf70f6
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:28 user nova-compute[72000]: INFO nova.virt.block_device [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Attempting to driver detach volume eee7f526-7ef4-4562-83e5-567b5edf70f6 from mountpoint /dev/vdb
Aug 16 18:05:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Attempting to detach device vdb from instance cef1b726-614c-4b75-8b44-5bc62f235424 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:05:28 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:05:28 user nova-compute[72000]:   <source dev="/dev/sdh"/>
Aug 16 18:05:28 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:05:28 user nova-compute[72000]:   <serial>eee7f526-7ef4-4562-83e5-567b5edf70f6</serial>
Aug 16 18:05:28 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:05:28 user nova-compute[72000]: </disk>
Aug 16 18:05:28 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:28 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Successfully detached device vdb from instance cef1b726-614c-4b75-8b44-5bc62f235424 from the persistent domain config.
Aug 16 18:05:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOiDNCLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:05:28 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 18:05:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[287fe84c-3db3-4db2-8ec0-ed63c7cccfa1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9483f8a6-4ab0-46bb-949e-4a5dd751ff7e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 (non-flash)
Aug 16 18:05:28 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:28 user nova-compute[72000]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 (non-flash)
Aug 16 18:05:28 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01c85dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6'): ({'sdh'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Removing single pathed devices sdh {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4681c110-652f-402b-bd10-1c5e48caf053]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48f5a08-1d8b-4f60-a541-6ab2a1a96f87]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flushing IO for device /dev/sdh {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:29 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:05:29 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=6915MB free_disk=23.97119903564453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d1fda-3094-47ff-a79a-2652914edb3b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.108s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a363f0-3925-4fc3-ba31-fc894a6b0653]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] SCSI volumes sdh have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25c9ba8-6e77-47cf-9139-b496c0b18065]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Applying migration context for instance a8532341-62b3-4c58-b3d8-db5440ad08c3 as it has an incoming, in-progress migration 03a9dd8d-4d9a-4244-b9fa-b8758ed333fd. Migration status is finished {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 18:05:29 user nova-compute[72000]: INFO nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating resource usage from migration 03a9dd8d-4d9a-4244-b9fa-b8758ed333fd
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance cef1b726-614c-4b75-8b44-5bc62f235424 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f5fc020a-3be1-4e78-8825-89f06406e945 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance b22234a2-c9cb-4a04-856c-ef718c80e59d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Migration 03a9dd8d-4d9a-4244-b9fa-b8758ed333fd is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a8532341-62b3-4c58-b3d8-db5440ad08c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[05354a74-2039-4063-b977-4017a1a2d017]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6, portal: 172.16.0.220,3260]
Aug 16 18:05:29 user nova-compute[72000]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6, portal: 172.16.0.220,3260] successful.
Aug 16 18:05:29 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f3ee6c-6121-42f2-b994-f9c3dfcf0373]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.094s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== disconnect_volume: return (1096ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "f5fc020a-3be1-4e78-8825-89f06406e945" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:29 user nova-compute[72000]: INFO nova.compute.manager [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Shelve offloading
Aug 16 18:05:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received event network-vif-plugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] Lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] Lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] No waiting events found dispatching network-vif-plugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:29 user nova-compute[72000]: WARNING nova.compute.manager [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received unexpected event network-vif-plugged-0f4c186b-25e4-4a47-a54e-d58d0abf66fa for instance with vm_state active and task_state rebuilding.
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-changed-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Refreshing instance network info cache due to event network-changed-ff6674fb-0507-4b0e-a63e-b541fa45d07e. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] Acquiring lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] Acquired lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Refreshing network info cache for port ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:05:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.861s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG nova.network.neutron [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updated VIF entry in instance network info cache for port ff6674fb-0507-4b0e-a63e-b541fa45d07e. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG nova.network.neutron [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating instance_info_cache with network_info: [{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:05:30 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Instance destroyed successfully.
Aug 16 18:05:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-291985954',display_name='tempest-ServerActionsTestOtherA-server-1287166797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-291985954',id=12,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFUjGaHE7pKkphpIlu+qb5TThvRrvfTMXIg6LvDq93nPXqpmsinbGBzE/z1sLW3pAtQ4HaRizKrUDwqgopKDrCUOR6hQe9eKG4sjH3iE9tGInsfqp0+BxDMbd8d9L+pnQ==',key_name='tempest-keypair-1405337443',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-r1k21jr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=cef1b726-614c-4b75-8b44-5bc62f235424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f4c186b-25e4-4a47-a54e-d58d0abf66fa,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4c186b-25') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_vif [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f4c186b-25e4-4a47-a54e-d58d0abf66fa,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4c186b-25') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f4c186b-25, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:30 user nova-compute[72000]: INFO os_vif [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f4c186b-25e4-4a47-a54e-d58d0abf66fa,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4c186b-25')
Aug 16 18:05:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-34a69a16-bfc9-4859-8d33-0232c491176b req-1dca7d65-9362-4f8b-9855-5702b9e2915a service nova] Releasing lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOiDNCLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:05:30 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b309074-122f-4889-ba8a-3cd910678534]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:30 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Instance destroyed successfully.
Aug 16 18:05:30 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquired lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fce785d-f3fc-49fc-9239-2622ad2a98f9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:30 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:30 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:30 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:30 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:30 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:30 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:30 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:30 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:30 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:30 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:30 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:30 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd00878caf0>, {}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Disconnecting from: [] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.096s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== disconnect_volume: return (97ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:05:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:05:30 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Deleting instance files /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424_del
Aug 16 18:05:30 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Deletion of /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424_del complete
Aug 16 18:05:30 user nova-compute[72000]: INFO nova.virt.block_device [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Booting with volume eee7f526-7ef4-4562-83e5-567b5edf70f6 at /dev/vdb
Aug 16 18:05:31 user nova-compute[72000]: DEBUG os_brick.utils [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[379153a9-9afa-4a5a-9c29-f0c0341030f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a36764b-004b-4e9b-8517-19c294f11bc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf091ec-e164-4487-a77f-1b030b2460fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fe1b35-296e-490d-aaac-047837bf8348]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:05:31 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b7e6ec-66b9-4c83-a4d7-c807f2e23348]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG os_brick.utils [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== get_connector_properties: return (200ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updating existing volume attachment record: 654b967b-538c-4b28-b155-9f48435f4416 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating instance_info_cache with network_info: [{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Releasing lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-vif-unplugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] No waiting events found dispatching network-vif-unplugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:31 user nova-compute[72000]: WARNING nova.compute.manager [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received unexpected event network-vif-unplugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e for instance with vm_state active and task_state shelving.
Aug 16 18:05:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] No waiting events found dispatching network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:05:31 user nova-compute[72000]: WARNING nova.compute.manager [req-7b4321a5-1307-4ea0-b269-7694d95a8523 req-3d97a895-2865-4356-835b-eabe587606c2 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received unexpected event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e for instance with vm_state active and task_state shelving.
Aug 16 18:05:32 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Instance destroyed successfully.
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.objects.instance [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lazy-loading 'resources' on Instance uuid f5fc020a-3be1-4e78-8825-89f06406e945 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671854720',display_name='tempest-TestShelveInstance-server-1671854720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671854720',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy10SwZ4bXKRC0dKCPy6fa0uY+bnVm3aNRZ8sBCF4oDMA+nZgCk9jKcPb8d0QkfWiDIWgt1qbCCse8HMygOI1Yr5uM1Lf8XlRV1BZ+gXxaguTOxe6XXmYzzDCkeBftw0Q==',key_name='tempest-TestShelveInstance-381507571',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e70b32f569148f598a9ea19771d9d64',ramdisk_id='',reservation_id='r-4l1srynu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-1203105608',owner_user_name='tempest-TestShelveInstance-1203105608-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:03:55Z,user_data=None,user_id='7bafbe976da14bcca011f17b17ca65ff',uuid=f5fc020a-3be1-4e78-8825-89f06406e945,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converting VIF {"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_vif [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff6674fb-05, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:05:32 user nova-compute[72000]: INFO os_vif [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05')
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkFJdhxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:05:32 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cf9fdf-2b17-4085-8472-01ea66ecf8a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ca167f-fcf4-42f3-a527-fe5aa11a184d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:32 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:32 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:32 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:32 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:32 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:05:32 user nova-compute[72000]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:05:32 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:05:32 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:05:32 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:05:32 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:05:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd019d35240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8'): ({'sdd'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Removing single pathed devices sdd {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[41315197-c55a-4646-8709-27ec09014b8d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68f2311-6420-4c82-bd71-0c4530b8cbf6]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Flushing IO for device /dev/sdd {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-db8b651d-77f4-4f3d-9a31-d05a0269aea2 req-2910ed71-7bc3-42a1-9803-4f104eea53e7 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-changed-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-db8b651d-77f4-4f3d-9a31-d05a0269aea2 req-2910ed71-7bc3-42a1-9803-4f104eea53e7 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Refreshing instance network info cache due to event network-changed-ff6674fb-0507-4b0e-a63e-b541fa45d07e. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-db8b651d-77f4-4f3d-9a31-d05a0269aea2 req-2910ed71-7bc3-42a1-9803-4f104eea53e7 service nova] Acquiring lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-db8b651d-77f4-4f3d-9a31-d05a0269aea2 req-2910ed71-7bc3-42a1-9803-4f104eea53e7 service nova] Acquired lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.network.neutron [req-db8b651d-77f4-4f3d-9a31-d05a0269aea2 req-2910ed71-7bc3-42a1-9803-4f104eea53e7 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Refreshing network info cache for port ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f820fa-bdc6-4e47-8291-b124c09a5c88]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa44d9f-2159-4106-8078-297dade9b285]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0f9074-e866-4155-8b0e-94cbcdfe0d9e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3e7dec-e094-4060-a9b7-969e57c2f811]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260]
Aug 16 18:05:32 user nova-compute[72000]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260] successful.
Aug 16 18:05:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3381278a-cf58-4e20-9098-133649ee9732]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] <== disconnect_volume: return (446ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:05:32 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Deleting instance files /opt/stack/data/nova/instances/f5fc020a-3be1-4e78-8825-89f06406e945_del
Aug 16 18:05:32 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Deletion of /opt/stack/data/nova/instances/f5fc020a-3be1-4e78-8825-89f06406e945_del complete
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.network.neutron [req-db8b651d-77f4-4f3d-9a31-d05a0269aea2 req-2910ed71-7bc3-42a1-9803-4f104eea53e7 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updated VIF entry in instance network info cache for port ff6674fb-0507-4b0e-a63e-b541fa45d07e. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:05:32 user nova-compute[72000]: DEBUG nova.network.neutron [req-db8b651d-77f4-4f3d-9a31-d05a0269aea2 req-2910ed71-7bc3-42a1-9803-4f104eea53e7 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating instance_info_cache with network_info: [{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": null, "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapff6674fb-05", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:05:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-db8b651d-77f4-4f3d-9a31-d05a0269aea2 req-2910ed71-7bc3-42a1-9803-4f104eea53e7 service nova] Releasing lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:05:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.volume.cinder [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Update attachment failed for attachment 654b967b-538c-4b28-b155-9f48435f4416. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 18:05:33 user nova-compute[72000]: Collecting current configuration:
Aug 16 18:05:33 user nova-compute[72000]: FATAL: Received the following error:
Aug 16 18:05:33 user nova-compute[72000]:         groups(): Target 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8' is not available
Aug 16 18:05:33 user nova-compute[72000]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -driver iscsi -attributes MaxSessions=0 -noprompt...).). (HTTP 500) (Request-ID: req-f467812a-be73-40ee-b49a-e35649a9680d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error: 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 18:05:33 user nova-compute[72000]: Collecting current configuration:
Aug 16 18:05:33 user nova-compute[72000]: FATAL: Received the following error:
Aug 16 18:05:33 user nova-compute[72000]:         groups(): Target 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8' is not available
Aug 16 18:05:33 user nova-compute[72000]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -driver iscsi -attributes MaxSessions=0 -noprompt...).). (HTTP 500) (Request-ID: req-f467812a-be73-40ee-b49a-e35649a9680d)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Traceback (most recent call last):
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self.driver.rebuild(**kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     raise NotImplementedError()
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] NotImplementedError
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] During handling of the above exception, another exception occurred:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Traceback (most recent call last):
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     driver_block_device.attach_block_devices(
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     _log_and_attach(device)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     bdm.attach(*attach_args, **attach_kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     ret_val = method(obj, context, *args, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self._do_attach(context, instance, volume, volume_api,
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self._volume_attach(context, volume, connector, instance,
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     connection_info = volume_api.attachment_update(
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     res = method(self, ctx, *args, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     with excutils.save_and_reraise_exception():
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self.force_reraise()
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     raise self.value
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     return method.func(obj, *args, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     resp = self._update('/attachments/%s' % id, body)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     return self.request(url, method, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     raise exceptions.from_response(resp, body)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Collecting current configuration:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] FATAL: Received the following error:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]         groups(): Target 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8' is not available
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -driver iscsi -attributes MaxSessions=0 -noprompt...).). (HTTP 500) (Request-ID: req-f467812a-be73-40ee-b49a-e35649a9680d)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Deleted allocations for instance f5fc020a-3be1-4e78-8825-89f06406e945
Aug 16 18:05:33 user nova-compute[72000]: DEBUG nova.compute.utils [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS {{(pid=72000) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 18:05:33 user nova-compute[72000]: Collecting current configuration:
Aug 16 18:05:33 user nova-compute[72000]: FATAL: Received the following error:
Aug 16 18:05:33 user nova-compute[72000]:         groups(): Target 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8' is not available
Aug 16 18:05:33 user nova-compute[72000]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -driver iscsi -attributes MaxSessions=0 -noprompt...).). (HTTP 500) (Request-ID: req-f467812a-be73-40ee-b49a-e35649a9680d)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Traceback (most recent call last):
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self.driver.rebuild(**kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     raise NotImplementedError()
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] NotImplementedError
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] During handling of the above exception, another exception occurred:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Traceback (most recent call last):
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     driver_block_device.attach_block_devices(
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     _log_and_attach(device)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     bdm.attach(*attach_args, **attach_kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     ret_val = method(obj, context, *args, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self._do_attach(context, instance, volume, volume_api,
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self._volume_attach(context, volume, connector, instance,
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     connection_info = volume_api.attachment_update(
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     res = method(self, ctx, *args, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     with excutils.save_and_reraise_exception():
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self.force_reraise()
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     raise self.value
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     return method.func(obj, *args, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     resp = self._update('/attachments/%s' % id, body)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     return self.request(url, method, **kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     raise exceptions.from_response(resp, body)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Collecting current configuration:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] FATAL: Received the following error:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]         groups(): Target 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8' is not available
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -driver iscsi -attributes MaxSessions=0 -noprompt...).). (HTTP 500) (Request-ID: req-f467812a-be73-40ee-b49a-e35649a9680d)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] During handling of the above exception, another exception occurred:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Traceback (most recent call last):
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/compute/manager.py", line 10766, in _error_out_instance_on_exception
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     yield
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/compute/manager.py", line 3841, in rebuild_instance
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self._do_rebuild_instance_with_claim(
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/compute/manager.py", line 3927, in _do_rebuild_instance_with_claim
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self._do_rebuild_instance(
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/compute/manager.py", line 4119, in _do_rebuild_instance
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     self._rebuild_default_impl(**kwargs)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/compute/manager.py", line 3703, in _rebuild_default_impl
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     new_block_device_info = attach_block_devices(context, instance, bdms)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]   File "/opt/stack/nova/nova/compute/manager.py", line 2193, in _prep_block_device
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]     raise exception.InvalidBDM(str(ex))
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Collecting current configuration:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] FATAL: Received the following error:
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424]         groups(): Target 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8' is not available
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -driver iscsi -attributes MaxSessions=0 -noprompt...).). (HTTP 500) (Request-ID: req-f467812a-be73-40ee-b49a-e35649a9680d)
Aug 16 18:05:33 user nova-compute[72000]: ERROR nova.compute.manager [instance: cef1b726-614c-4b75-8b44-5bc62f235424] 
Aug 16 18:05:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:33 user nova-compute[72000]: DEBUG nova.objects.instance [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lazy-loading 'numa_topology' on Instance uuid f5fc020a-3be1-4e78-8825-89f06406e945 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:05:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:05:34 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:05:34 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:05:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.246s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:05:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cd55199e-97d7-4267-9ce4-bcfb9d77f8e3 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "f5fc020a-3be1-4e78-8825-89f06406e945" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.789s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:34 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:05:34 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:05:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:05:34 user nova-compute[72000]: INFO nova.compute.manager [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server [None req-fffda6c0-c49d-447b-9609-940bc653cd27 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 18:05:34 user nova-compute[72000]: Collecting current configuration:
Aug 16 18:05:34 user nova-compute[72000]: FATAL: Received the following error:
Aug 16 18:05:34 user nova-compute[72000]:         groups(): Target 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8' is not available
Aug 16 18:05:34 user nova-compute[72000]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -driver iscsi -attributes MaxSessions=0 -noprompt...).). (HTTP 500) (Request-ID: req-f467812a-be73-40ee-b49a-e35649a9680d)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server NotImplementedError
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server Collecting current configuration:
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server FATAL: Received the following error:
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server         groups(): Target 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8' is not available
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -driver iscsi -attributes MaxSessions=0 -noprompt...).). (HTTP 500) (Request-ID: req-f467812a-be73-40ee-b49a-e35649a9680d)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3841, in rebuild_instance
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3927, in _do_rebuild_instance_with_claim
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4119, in _do_rebuild_instance
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3703, in _rebuild_default_impl
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2193, in _prep_block_device
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server Collecting current configuration:
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server FATAL: Received the following error:
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server         groups(): Target 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8' is not available
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6 -driver iscsi -attributes MaxSessions=0 -noprompt...).). (HTTP 500) (Request-ID: req-f467812a-be73-40ee-b49a-e35649a9680d)
Aug 16 18:05:34 user nova-compute[72000]: ERROR oslo_messaging.rpc.server 
Aug 16 18:05:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:42 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209127.937527, cef1b726-614c-4b75-8b44-5bc62f235424 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:42 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] VM Stopped (Lifecycle Event)
Aug 16 18:05:42 user nova-compute[72000]: DEBUG nova.compute.manager [None req-23064cef-377c-40cf-a052-fa432eb1b1d9 None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:45 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209130.6560452, f5fc020a-3be1-4e78-8825-89f06406e945 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:05:45 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] VM Stopped (Lifecycle Event)
Aug 16 18:05:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1615c885-3c07-49cd-a720-281adaf13789 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:05:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:05:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Acquiring lock "d76a0b56-0337-45a0-96db-83c267d5d649" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "d76a0b56-0337-45a0-96db-83c267d5d649" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:06:01 user nova-compute[72000]: INFO nova.compute.claims [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Claim successful on node user
Aug 16 18:06:01 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:06:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:06:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:06:01 user nova-compute[72000]: DEBUG nova.policy [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ccb2de1e2a453e850090025d9197a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861bb8b3ad41464da8b5299c21bbf322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:06:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Creating image(s)
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Acquiring lock "/opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "/opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "/opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk 1073741824" returned: 0 in 0.060s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Successfully created port: 4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.209s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Cannot resize image /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG nova.objects.instance [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lazy-loading 'migration_context' on Instance uuid d76a0b56-0337-45a0-96db-83c267d5d649 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Ensure instance console log exists: /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Successfully updated port: 4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Acquiring lock "refresh_cache-d76a0b56-0337-45a0-96db-83c267d5d649" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Acquired lock "refresh_cache-d76a0b56-0337-45a0-96db-83c267d5d649" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-d5f8d8de-4475-4ef8-ba58-f6f97d4e0c10 req-8090fbb9-023c-4276-b8b7-33158ea40976 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Received event network-changed-4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-d5f8d8de-4475-4ef8-ba58-f6f97d4e0c10 req-8090fbb9-023c-4276-b8b7-33158ea40976 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Refreshing instance network info cache due to event network-changed-4b6135e2-5eef-484e-a2b7-f39c78e1b225. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d5f8d8de-4475-4ef8-ba58-f6f97d4e0c10 req-8090fbb9-023c-4276-b8b7-33158ea40976 service nova] Acquiring lock "refresh_cache-d76a0b56-0337-45a0-96db-83c267d5d649" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Updating instance_info_cache with network_info: [{"id": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "address": "fa:16:3e:5f:1b:31", "network": {"id": "bc32474a-9a54-423d-afbc-3f36e485673c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1763676722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861bb8b3ad41464da8b5299c21bbf322", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6135e2-5e", "ovs_interfaceid": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Releasing lock "refresh_cache-d76a0b56-0337-45a0-96db-83c267d5d649" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Instance network_info: |[{"id": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "address": "fa:16:3e:5f:1b:31", "network": {"id": "bc32474a-9a54-423d-afbc-3f36e485673c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1763676722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861bb8b3ad41464da8b5299c21bbf322", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6135e2-5e", "ovs_interfaceid": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d5f8d8de-4475-4ef8-ba58-f6f97d4e0c10 req-8090fbb9-023c-4276-b8b7-33158ea40976 service nova] Acquired lock "refresh_cache-d76a0b56-0337-45a0-96db-83c267d5d649" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.network.neutron [req-d5f8d8de-4475-4ef8-ba58-f6f97d4e0c10 req-8090fbb9-023c-4276-b8b7-33158ea40976 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Refreshing network info cache for port 4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Start _get_guest_xml network_info=[{"id": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "address": "fa:16:3e:5f:1b:31", "network": {"id": "bc32474a-9a54-423d-afbc-3f36e485673c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1763676722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861bb8b3ad41464da8b5299c21bbf322", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6135e2-5e", "ovs_interfaceid": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:06:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:06:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1761531755',display_name='tempest-VolumesActionsTest-instance-1761531755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1761531755',id=18,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861bb8b3ad41464da8b5299c21bbf322',ramdisk_id='',reservation_id='r-wblzhhgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1565940609',owner_user_name='tempest-VolumesActionsTest-1565940609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:02Z,user_data=None,user_id='94ccb2de1e2a453e850090025d9197a3',uuid=d76a0b56-0337-45a0-96db-83c267d5d649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "address": "fa:16:3e:5f:1b:31", "network": {"id": "bc32474a-9a54-423d-afbc-3f36e485673c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1763676722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861bb8b3ad41464da8b5299c21bbf322", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6135e2-5e", "ovs_interfaceid": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Converting VIF {"id": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "address": "fa:16:3e:5f:1b:31", "network": {"id": "bc32474a-9a54-423d-afbc-3f36e485673c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1763676722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861bb8b3ad41464da8b5299c21bbf322", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6135e2-5e", "ovs_interfaceid": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=4b6135e2-5eef-484e-a2b7-f39c78e1b225,network=Network(bc32474a-9a54-423d-afbc-3f36e485673c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6135e2-5e') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.objects.instance [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lazy-loading 'pci_devices' on Instance uuid d76a0b56-0337-45a0-96db-83c267d5d649 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:06:04 user nova-compute[72000]:   <uuid>d76a0b56-0337-45a0-96db-83c267d5d649</uuid>
Aug 16 18:06:04 user nova-compute[72000]:   <name>instance-00000012</name>
Aug 16 18:06:04 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:06:04 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:06:04 user nova-compute[72000]:   <metadata>
Aug 16 18:06:04 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:06:04 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:06:04 user nova-compute[72000]:       <nova:name>tempest-VolumesActionsTest-instance-1761531755</nova:name>
Aug 16 18:06:04 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:06:04</nova:creationTime>
Aug 16 18:06:04 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:06:04 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:06:04 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:06:04 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:06:04 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:06:04 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:06:04 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:06:04 user nova-compute[72000]:       <nova:owner>
Aug 16 18:06:04 user nova-compute[72000]:         <nova:user uuid="94ccb2de1e2a453e850090025d9197a3">tempest-VolumesActionsTest-1565940609-project-member</nova:user>
Aug 16 18:06:04 user nova-compute[72000]:         <nova:project uuid="861bb8b3ad41464da8b5299c21bbf322">tempest-VolumesActionsTest-1565940609</nova:project>
Aug 16 18:06:04 user nova-compute[72000]:       </nova:owner>
Aug 16 18:06:04 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:06:04 user nova-compute[72000]:       <nova:ports>
Aug 16 18:06:04 user nova-compute[72000]:         <nova:port uuid="4b6135e2-5eef-484e-a2b7-f39c78e1b225">
Aug 16 18:06:04 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 18:06:04 user nova-compute[72000]:         </nova:port>
Aug 16 18:06:04 user nova-compute[72000]:       </nova:ports>
Aug 16 18:06:04 user nova-compute[72000]:     </nova:instance>
Aug 16 18:06:04 user nova-compute[72000]:   </metadata>
Aug 16 18:06:04 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:06:04 user nova-compute[72000]:     <system>
Aug 16 18:06:04 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:06:04 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:06:04 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:06:04 user nova-compute[72000]:       <entry name="serial">d76a0b56-0337-45a0-96db-83c267d5d649</entry>
Aug 16 18:06:04 user nova-compute[72000]:       <entry name="uuid">d76a0b56-0337-45a0-96db-83c267d5d649</entry>
Aug 16 18:06:04 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:06:04 user nova-compute[72000]:     </system>
Aug 16 18:06:04 user nova-compute[72000]:   </sysinfo>
Aug 16 18:06:04 user nova-compute[72000]:   <os>
Aug 16 18:06:04 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:06:04 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:06:04 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:06:04 user nova-compute[72000]:   </os>
Aug 16 18:06:04 user nova-compute[72000]:   <features>
Aug 16 18:06:04 user nova-compute[72000]:     <acpi/>
Aug 16 18:06:04 user nova-compute[72000]:     <apic/>
Aug 16 18:06:04 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:06:04 user nova-compute[72000]:   </features>
Aug 16 18:06:04 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:06:04 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:06:04 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:06:04 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:06:04 user nova-compute[72000]:   </clock>
Aug 16 18:06:04 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:06:04 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:06:04 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:06:04 user nova-compute[72000]:   </cpu>
Aug 16 18:06:04 user nova-compute[72000]:   <devices>
Aug 16 18:06:04 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:06:04 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:06:04 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk"/>
Aug 16 18:06:04 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:06:04 user nova-compute[72000]:     </disk>
Aug 16 18:06:04 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:06:04 user nova-compute[72000]:       <mac address="fa:16:3e:5f:1b:31"/>
Aug 16 18:06:04 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:06:04 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:06:04 user nova-compute[72000]:       <target dev="tap4b6135e2-5e"/>
Aug 16 18:06:04 user nova-compute[72000]:     </interface>
Aug 16 18:06:04 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:06:04 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/console.log" append="off"/>
Aug 16 18:06:04 user nova-compute[72000]:     </serial>
Aug 16 18:06:04 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:06:04 user nova-compute[72000]:     <video>
Aug 16 18:06:04 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:06:04 user nova-compute[72000]:     </video>
Aug 16 18:06:04 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:06:04 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:06:04 user nova-compute[72000]:     </rng>
Aug 16 18:06:04 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:06:04 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:06:04 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:06:04 user nova-compute[72000]:     </memballoon>
Aug 16 18:06:04 user nova-compute[72000]:   </devices>
Aug 16 18:06:04 user nova-compute[72000]: </domain>
Aug 16 18:06:04 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1761531755',display_name='tempest-VolumesActionsTest-instance-1761531755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1761531755',id=18,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861bb8b3ad41464da8b5299c21bbf322',ramdisk_id='',reservation_id='r-wblzhhgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1565940609',owner_user_name='tempest-VolumesActionsTest-1565940609-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:02Z,user_data=None,user_id='94ccb2de1e2a453e850090025d9197a3',uuid=d76a0b56-0337-45a0-96db-83c267d5d649,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "address": "fa:16:3e:5f:1b:31", "network": {"id": "bc32474a-9a54-423d-afbc-3f36e485673c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1763676722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861bb8b3ad41464da8b5299c21bbf322", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6135e2-5e", "ovs_interfaceid": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Converting VIF {"id": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "address": "fa:16:3e:5f:1b:31", "network": {"id": "bc32474a-9a54-423d-afbc-3f36e485673c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1763676722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861bb8b3ad41464da8b5299c21bbf322", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6135e2-5e", "ovs_interfaceid": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=4b6135e2-5eef-484e-a2b7-f39c78e1b225,network=Network(bc32474a-9a54-423d-afbc-3f36e485673c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6135e2-5e') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG os_vif [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=4b6135e2-5eef-484e-a2b7-f39c78e1b225,network=Network(bc32474a-9a54-423d-afbc-3f36e485673c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6135e2-5e') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b6135e2-5e, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b6135e2-5e, col_values=(('external_ids', {'iface-id': '4b6135e2-5eef-484e-a2b7-f39c78e1b225', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:1b:31', 'vm-uuid': 'd76a0b56-0337-45a0-96db-83c267d5d649'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:04 user nova-compute[72000]: INFO os_vif [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=4b6135e2-5eef-484e-a2b7-f39c78e1b225,network=Network(bc32474a-9a54-423d-afbc-3f36e485673c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6135e2-5e')
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:06:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] No VIF found with MAC fa:16:3e:5f:1b:31, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:06:05 user nova-compute[72000]: DEBUG nova.network.neutron [req-d5f8d8de-4475-4ef8-ba58-f6f97d4e0c10 req-8090fbb9-023c-4276-b8b7-33158ea40976 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Updated VIF entry in instance network info cache for port 4b6135e2-5eef-484e-a2b7-f39c78e1b225. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:06:05 user nova-compute[72000]: DEBUG nova.network.neutron [req-d5f8d8de-4475-4ef8-ba58-f6f97d4e0c10 req-8090fbb9-023c-4276-b8b7-33158ea40976 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Updating instance_info_cache with network_info: [{"id": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "address": "fa:16:3e:5f:1b:31", "network": {"id": "bc32474a-9a54-423d-afbc-3f36e485673c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1763676722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861bb8b3ad41464da8b5299c21bbf322", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6135e2-5e", "ovs_interfaceid": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d5f8d8de-4475-4ef8-ba58-f6f97d4e0c10 req-8090fbb9-023c-4276-b8b7-33158ea40976 service nova] Releasing lock "refresh_cache-d76a0b56-0337-45a0-96db-83c267d5d649" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-bc7896be-9d2f-493f-83ea-dad8de3176a9 req-73cca890-a0e6-421e-97aa-8e0cac528653 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Received event network-vif-plugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bc7896be-9d2f-493f-83ea-dad8de3176a9 req-73cca890-a0e6-421e-97aa-8e0cac528653 service nova] Acquiring lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bc7896be-9d2f-493f-83ea-dad8de3176a9 req-73cca890-a0e6-421e-97aa-8e0cac528653 service nova] Lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bc7896be-9d2f-493f-83ea-dad8de3176a9 req-73cca890-a0e6-421e-97aa-8e0cac528653 service nova] Lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-bc7896be-9d2f-493f-83ea-dad8de3176a9 req-73cca890-a0e6-421e-97aa-8e0cac528653 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] No waiting events found dispatching network-vif-plugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:06 user nova-compute[72000]: WARNING nova.compute.manager [req-bc7896be-9d2f-493f-83ea-dad8de3176a9 req-73cca890-a0e6-421e-97aa-8e0cac528653 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Received unexpected event network-vif-plugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 for instance with vm_state building and task_state spawning.
Aug 16 18:06:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209168.4370966, d76a0b56-0337-45a0-96db-83c267d5d649 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:06:08 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] VM Resumed (Lifecycle Event)
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:06:08 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Instance spawned successfully.
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-80c39847-4686-4631-ac1b-429598845bda req-ca26fff1-dc0e-4ce2-ad29-95705a06d35f service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Received event network-vif-plugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-80c39847-4686-4631-ac1b-429598845bda req-ca26fff1-dc0e-4ce2-ad29-95705a06d35f service nova] Acquiring lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-80c39847-4686-4631-ac1b-429598845bda req-ca26fff1-dc0e-4ce2-ad29-95705a06d35f service nova] Lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-80c39847-4686-4631-ac1b-429598845bda req-ca26fff1-dc0e-4ce2-ad29-95705a06d35f service nova] Lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-80c39847-4686-4631-ac1b-429598845bda req-ca26fff1-dc0e-4ce2-ad29-95705a06d35f service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] No waiting events found dispatching network-vif-plugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:08 user nova-compute[72000]: WARNING nova.compute.manager [req-80c39847-4686-4631-ac1b-429598845bda req-ca26fff1-dc0e-4ce2-ad29-95705a06d35f service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Received unexpected event network-vif-plugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 for instance with vm_state building and task_state spawning.
Aug 16 18:06:08 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209168.4383948, d76a0b56-0337-45a0-96db-83c267d5d649 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:06:08 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] VM Started (Lifecycle Event)
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:06:08 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:06:08 user nova-compute[72000]: INFO nova.compute.manager [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:08 user nova-compute[72000]: INFO nova.compute.manager [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Took 7.39 seconds to build instance.
Aug 16 18:06:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cc771386-8657-4225-8694-08014306f195 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "d76a0b56-0337-45a0-96db-83c267d5d649" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.485s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:08 user nova-compute[72000]: INFO nova.compute.manager [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Terminating instance
Aug 16 18:06:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:09 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Instance destroyed successfully.
Aug 16 18:06:09 user nova-compute[72000]: DEBUG nova.objects.instance [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lazy-loading 'resources' on Instance uuid 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1181340656',display_name='tempest-VolumesAdminNegativeTest-server-1181340656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1181340656',id=14,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:04:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ad509a974084c17ac6ffac36ca72c50',ramdisk_id='',reservation_id='r-cu1v1aia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-127684415',owner_user_name='tempest-VolumesAdminNegativeTest-127684415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:04:15Z,user_data=None,user_id='090a1c872b734d0bb3daede325eca0df',uuid=3e53d54d-0eb5-4ff9-ad1c-8c1277697a23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "address": "fa:16:3e:d0:ac:3e", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782d6cc-6b", "ovs_interfaceid": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converting VIF {"id": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "address": "fa:16:3e:d0:ac:3e", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7782d6cc-6b", "ovs_interfaceid": "7782d6cc-6b1b-4029-92d3-03b8fd65b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=7782d6cc-6b1b-4029-92d3-03b8fd65b90a,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7782d6cc-6b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG os_vif [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=7782d6cc-6b1b-4029-92d3-03b8fd65b90a,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7782d6cc-6b') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7782d6cc-6b, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:06:09 user nova-compute[72000]: INFO os_vif [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ac:3e,bridge_name='br-int',has_traffic_filtering=True,id=7782d6cc-6b1b-4029-92d3-03b8fd65b90a,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7782d6cc-6b')
Aug 16 18:06:09 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Deleting instance files /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23_del
Aug 16 18:06:09 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Deletion of /opt/stack/data/nova/instances/3e53d54d-0eb5-4ff9-ad1c-8c1277697a23_del complete
Aug 16 18:06:09 user nova-compute[72000]: INFO nova.compute.manager [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 16 18:06:09 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:06:09 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:10 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Took 0.72 seconds to deallocate network for instance.
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-6f8f7879-496f-47c2-ae84-fa512f9e8d6a req-608d4657-0efd-4ea7-9668-c2330ad7efc6 service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Received event network-vif-deleted-7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Received event network-vif-unplugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] Acquiring lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] No waiting events found dispatching network-vif-unplugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:10 user nova-compute[72000]: WARNING nova.compute.manager [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Received unexpected event network-vif-unplugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a for instance with vm_state deleted and task_state None.
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Received event network-vif-plugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] Acquiring lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] No waiting events found dispatching network-vif-plugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:10 user nova-compute[72000]: WARNING nova.compute.manager [req-4aa1355e-b566-4120-bf45-972a335cf3df req-4b391960-b3c1-482e-8dd5-65a030efc04e service nova] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Received unexpected event network-vif-plugged-7782d6cc-6b1b-4029-92d3-03b8fd65b90a for instance with vm_state deleted and task_state None.
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:10 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Deleted allocations for instance 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e046d4f7-1366-472e-8fff-7674666077b7 tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "3e53d54d-0eb5-4ff9-ad1c-8c1277697a23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.980s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:11 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:06:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:06:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:06:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:06:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:06:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:06:22 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:06:22 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:06:22 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7159MB free_disk=23.95598602294922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:06:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:22 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Applying migration context for instance a8532341-62b3-4c58-b3d8-db5440ad08c3 as it has an incoming, in-progress migration 03a9dd8d-4d9a-4244-b9fa-b8758ed333fd. Migration status is finished {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 18:06:22 user nova-compute[72000]: INFO nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating resource usage from migration 03a9dd8d-4d9a-4244-b9fa-b8758ed333fd
Aug 16 18:06:22 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance b22234a2-c9cb-4a04-856c-ef718c80e59d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Migration 03a9dd8d-4d9a-4244-b9fa-b8758ed333fd is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a8532341-62b3-4c58-b3d8-db5440ad08c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance d76a0b56-0337-45a0-96db-83c267d5d649 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:23 user nova-compute[72000]: INFO nova.compute.manager [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Detaching volume 2b319930-55cc-4304-87b2-b1777b2fbe7d
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.756s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:23 user nova-compute[72000]: INFO nova.virt.block_device [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Attempting to driver detach volume 2b319930-55cc-4304-87b2-b1777b2fbe7d from mountpoint /dev/vdb
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Attempting to detach device vdb from instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:06:23 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:06:23 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:06:23 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:06:23 user nova-compute[72000]:   <serial>2b319930-55cc-4304-87b2-b1777b2fbe7d</serial>
Aug 16 18:06:23 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 18:06:23 user nova-compute[72000]: </disk>
Aug 16 18:06:23 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:06:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully detached device vdb from instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c from the persistent domain config.
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:06:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:06:23 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:06:23 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:06:23 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:06:23 user nova-compute[72000]:   <serial>2b319930-55cc-4304-87b2-b1777b2fbe7d</serial>
Aug 16 18:06:23 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 18:06:23 user nova-compute[72000]: </disk>
Aug 16 18:06:23 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209184.0359423, f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:06:24 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully detached device vdb from instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c from the live domain config.
Aug 16 18:06:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'myzoFxvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:06:24 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54a2916-80c5-4d72-a206-30d0fa24e56d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b454ae6-bfa2-49ab-ba54-5de9ac744693]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:06:24 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:06:24 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:06:24 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:06:24 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:06:24 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d (non-flash)
Aug 16 18:06:24 user nova-compute[72000]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:06:24 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:06:24 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:06:24 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:06:24 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd019d35240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ebf397-8137-44ac-99b1-44f4c3b1b30f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8c9538-9b83-4fc1-93dc-684de261b83e]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3678a3dc-5d2b-4790-8af4-ca6a37f7235f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bb2e7e-2644-4b76-a09b-d9cda51def3d]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fb55f3-af64-4c0e-bfc9-909b4e8a05dd]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0916d648-7ada-4159-9def-bcc3c89415cb]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260]
Aug 16 18:06:24 user nova-compute[72000]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d, portal: 172.16.0.220,3260] successful.
Aug 16 18:06:24 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b319930-55cc-4304-87b2-b1777b2fbe7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0539cc76-863c-4a70-b3bb-c99aa5ca5069]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== disconnect_volume: return (266ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209169.3252215, 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:06:24 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] VM Stopped (Lifecycle Event)
Aug 16 18:06:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-bec54ad6-02c7-4958-a086-acdba6fcc582 None None] [instance: 3e53d54d-0eb5-4ff9-ad1c-8c1277697a23] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0537f09d-e864-4f1d-995f-ef94903cbd82 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a4d47acb-a022-41a4-ba3f-d865c18d7f76 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a4d47acb-a022-41a4-ba3f-d865c18d7f76 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.011s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a4d47acb-a022-41a4-ba3f-d865c18d7f76 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a4d47acb-a022-41a4-ba3f-d865c18d7f76 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72000) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a4d47acb-a022-41a4-ba3f-d865c18d7f76 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:06:25 user nova-compute[72000]: INFO nova.compute.claims [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Claim successful on node user
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.compute.manager [req-e2659ab0-d99d-4821-9b2e-eadf30c02c23 req-5376928f-eb93-42f7-abb8-1265e56f0a54 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-unplugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e2659ab0-d99d-4821-9b2e-eadf30c02c23 req-5376928f-eb93-42f7-abb8-1265e56f0a54 service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e2659ab0-d99d-4821-9b2e-eadf30c02c23 req-5376928f-eb93-42f7-abb8-1265e56f0a54 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e2659ab0-d99d-4821-9b2e-eadf30c02c23 req-5376928f-eb93-42f7-abb8-1265e56f0a54 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.compute.manager [req-e2659ab0-d99d-4821-9b2e-eadf30c02c23 req-5376928f-eb93-42f7-abb8-1265e56f0a54 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-unplugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:26 user nova-compute[72000]: WARNING nova.compute.manager [req-e2659ab0-d99d-4821-9b2e-eadf30c02c23 req-5376928f-eb93-42f7-abb8-1265e56f0a54 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-unplugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state active and task_state powering-off.
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:06:26 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance destroyed successfully.
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a4d47acb-a022-41a4-ba3f-d865c18d7f76 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:06:26 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a4d47acb-a022-41a4-ba3f-d865c18d7f76 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.907s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:06:26 user nova-compute[72000]: INFO nova.virt.block_device [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Booting with volume 6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 at /dev/vda
Aug 16 18:06:26 user nova-compute[72000]: DEBUG os_brick.utils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbfc58d-99e6-421b-8d47-0962580b41d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eb0877-5f11-4098-9868-579d9c2bed7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9339eea0-d743-4b6d-9b8a-c53566950791]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4b2c29-8cc2-4974-87e0-6f28c34ee422]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:06:26 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:06:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db2010c-c055-4ea3-bfbf-27d2992b2384]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG os_brick.utils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating existing volume attachment record: 57cbe97a-d7f9-4fe7-be17-d412790e76ec {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:06:26 user nova-compute[72000]: DEBUG nova.policy [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8dd1f88737aa49e3b635f8e3dbf4d025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df15c3db43cb4d6b925b43632d88617a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:06:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-d732e8af-88d7-42ba-bfe0-cf48aaec205b req-d01ced37-f1dd-4998-bff1-5edd3efe159b service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d732e8af-88d7-42ba-bfe0-cf48aaec205b req-d01ced37-f1dd-4998-bff1-5edd3efe159b service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d732e8af-88d7-42ba-bfe0-cf48aaec205b req-d01ced37-f1dd-4998-bff1-5edd3efe159b service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d732e8af-88d7-42ba-bfe0-cf48aaec205b req-d01ced37-f1dd-4998-bff1-5edd3efe159b service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-d732e8af-88d7-42ba-bfe0-cf48aaec205b req-d01ced37-f1dd-4998-bff1-5edd3efe159b service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:28 user nova-compute[72000]: WARNING nova.compute.manager [req-d732e8af-88d7-42ba-bfe0-cf48aaec205b req-d01ced37-f1dd-4998-bff1-5edd3efe159b service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state stopped and task_state None.
Aug 16 18:06:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully created port: cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:06:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Port 548341b0-47da-4962-b21a-fd4cc4118bdc binding to destination host user is already ACTIVE {{(pid=72000) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 18:06:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquired lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Releasing lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Creating tmpfile /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/tmpw5n0gh8i to verify with other compute node that the instance is on the same shared storage. {{(pid=72000) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully created port: f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG nova.compute.manager [req-36ff13b1-9701-4931-8092-c9563899d9a0 req-22d801f6-7484-485e-9294-dca28f110db4 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-unplugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36ff13b1-9701-4931-8092-c9563899d9a0 req-22d801f6-7484-485e-9294-dca28f110db4 service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36ff13b1-9701-4931-8092-c9563899d9a0 req-22d801f6-7484-485e-9294-dca28f110db4 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36ff13b1-9701-4931-8092-c9563899d9a0 req-22d801f6-7484-485e-9294-dca28f110db4 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG nova.compute.manager [req-36ff13b1-9701-4931-8092-c9563899d9a0 req-22d801f6-7484-485e-9294-dca28f110db4 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-unplugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:30 user nova-compute[72000]: WARNING nova.compute.manager [req-36ff13b1-9701-4931-8092-c9563899d9a0 req-22d801f6-7484-485e-9294-dca28f110db4 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-unplugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state resized and task_state resize_reverting.
Aug 16 18:06:30 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance destroyed successfully.
Aug 16 18:06:30 user nova-compute[72000]: DEBUG nova.objects.instance [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'resources' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-158489387',display_name='tempest-ServerActionsTestOtherB-server-158489387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-158489387',id=4,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrdiqOjF0w82oTGC6W8NyzHji/AAi+fARuYFDptSsxWEW2f7mWefGKfWyQtISbWHzqnq0YFbbPnDR8XKw6XPCJva4Yjg8+O3HxmlUuJZCmEJf2X0VZ0VVhtvx/qeQ8XoQ==',key_name='tempest-keypair-1407087314',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df523a13c0914e4ea7c2782d10e6535c',ramdisk_id='',reservation_id='r-hdgm4kha',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915732487',owner_user_name='tempest-ServerActionsTestOtherB-915732487-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb202933952474c99d17811058efc7c',uuid=a8532341-62b3-4c58-b3d8-db5440ad08c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converting VIF {"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG os_vif [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap548341b0-47, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:30 user nova-compute[72000]: INFO os_vif [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47')
Aug 16 18:06:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:06:30 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:06:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:06:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[041e6ae5-f71f-43f6-8525-6a38f93fe355]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e81c4c-647e-47cb-a1af-b7000387f214]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:06:31 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:06:31 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:06:31 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:06:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:06:31 user nova-compute[72000]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:06:31 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:06:31 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:06:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0082c63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully created port: 20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32fc1d3-810c-4527-8ba7-f4c3180ac5e8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2354c45b-7f0f-4841-b4c1-41dd29ee2202]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f8e20c-5100-47d3-b86d-83fd6c0ac787]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c2dbc-5949-450a-8ff4-c30df6f89dcb]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b47140-6559-4b69-b218-b5f2f3ff9fb5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70e58df-1f77-4870-8e60-875890ebad81]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]
Aug 16 18:06:31 user nova-compute[72000]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.
Aug 16 18:06:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[184a4141-348c-4a2a-95fd-c9a9de7d067a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] <== disconnect_volume: return (332ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:06:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully created port: 5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:06:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully created port: 8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:06:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-7b2290c3-6309-4fb7-bd81-7d15a5c05c54 req-252703d2-da53-4638-af22-acb988053fa4 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7b2290c3-6309-4fb7-bd81-7d15a5c05c54 req-252703d2-da53-4638-af22-acb988053fa4 service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7b2290c3-6309-4fb7-bd81-7d15a5c05c54 req-252703d2-da53-4638-af22-acb988053fa4 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7b2290c3-6309-4fb7-bd81-7d15a5c05c54 req-252703d2-da53-4638-af22-acb988053fa4 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-7b2290c3-6309-4fb7-bd81-7d15a5c05c54 req-252703d2-da53-4638-af22-acb988053fa4 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:32 user nova-compute[72000]: WARNING nova.compute.manager [req-7b2290c3-6309-4fb7-bd81-7d15a5c05c54 req-252703d2-da53-4638-af22-acb988053fa4 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state resized and task_state resize_reverting.
Aug 16 18:06:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully updated port: cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG nova.compute.manager [req-2c339db5-8212-42e1-b446-3135a7ab12e6 req-8633493d-8dc8-46d7-8e41-6609f820b5e2 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-changed-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG nova.compute.manager [req-2c339db5-8212-42e1-b446-3135a7ab12e6 req-8633493d-8dc8-46d7-8e41-6609f820b5e2 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing instance network info cache due to event network-changed-cf295ae9-9926-431c-8b42-7be3820eee21. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2c339db5-8212-42e1-b446-3135a7ab12e6 req-8633493d-8dc8-46d7-8e41-6609f820b5e2 service nova] Acquiring lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2c339db5-8212-42e1-b446-3135a7ab12e6 req-8633493d-8dc8-46d7-8e41-6609f820b5e2 service nova] Acquired lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG nova.network.neutron [req-2c339db5-8212-42e1-b446-3135a7ab12e6 req-8633493d-8dc8-46d7-8e41-6609f820b5e2 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing network info cache for port cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:06:33 user nova-compute[72000]: INFO nova.compute.claims [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Claim successful on node user
Aug 16 18:06:33 user nova-compute[72000]: DEBUG nova.network.neutron [req-2c339db5-8212-42e1-b446-3135a7ab12e6 req-8633493d-8dc8-46d7-8e41-6609f820b5e2 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:06:33 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:06:34 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.policy [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '135d5cc19e204a448036340be3ad519a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b0883d8fa04d16ba310cd8ce6dbaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:06:34 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Creating image(s)
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "/opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "/opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "/opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully updated port: edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-2c339db5-8212-42e1-b446-3135a7ab12e6 req-8633493d-8dc8-46d7-8e41-6609f820b5e2 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2c339db5-8212-42e1-b446-3135a7ab12e6 req-8633493d-8dc8-46d7-8e41-6609f820b5e2 service nova] Releasing lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk 1073741824" returned: 0 in 0.048s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Successfully created port: 570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.196s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:06:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Cannot resize image /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.objects.instance [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'migration_context' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Ensure instance console log exists: /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully updated port: c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-changed-edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing instance network info cache due to event network-changed-edd566b2-37d8-49b0-9c69-e35d9de5833e. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] Acquiring lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] Acquired lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing network info cache for port edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Successfully updated port: 570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquired lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-8367c1c7-60c5-4e93-a2a7-791031230ecf req-3c8416fa-1661-4865-9133-205bd5ae5d53 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-changed-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-8367c1c7-60c5-4e93-a2a7-791031230ecf req-3c8416fa-1661-4865-9133-205bd5ae5d53 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Refreshing instance network info cache due to event network-changed-570f94a4-3d2e-44e9-931f-147ee993a9e2. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8367c1c7-60c5-4e93-a2a7-791031230ecf req-3c8416fa-1661-4865-9133-205bd5ae5d53 service nova] Acquiring lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:06:35 user nova-compute[72000]: WARNING nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] While synchronizing instance power states, found 12 instances in the database and 8 instances on the hypervisor.
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid b22234a2-c9cb-4a04-856c-ef718c80e59d {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid d76a0b56-0337-45a0-96db-83c267d5d649 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: INFO nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "966d4480-7413-43bc-9b0f-6a522e88908b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "d76a0b56-0337-45a0-96db-83c267d5d649" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "d76a0b56-0337-45a0-96db-83c267d5d649" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "966d4480-7413-43bc-9b0f-6a522e88908b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "d76a0b56-0337-45a0-96db-83c267d5d649" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: INFO nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully updated port: f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] Releasing lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-changed-c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing instance network info cache due to event network-changed-c803184c-44f7-48cc-aead-7e7ef312d397. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] Acquiring lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] Acquired lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing network info cache for port c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.196s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updating instance_info_cache with network_info: [{"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Releasing lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Instance network_info: |[{"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8367c1c7-60c5-4e93-a2a7-791031230ecf req-3c8416fa-1661-4865-9133-205bd5ae5d53 service nova] Acquired lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-8367c1c7-60c5-4e93-a2a7-791031230ecf req-3c8416fa-1661-4865-9133-205bd5ae5d53 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Refreshing network info cache for port 570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Start _get_guest_xml network_info=[{"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:06:36 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:06:36 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2067903681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2067903681',id=20,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzAIQ4Qj/buGVYTF9Q5oTXmTmubqVmbfas/Gwlki1gZXYF6B7LxmZeceF68CptfGwnNe4ghrEiOtNYM248dcgGpuXQVyEeF0szdyiRkBTm+GkDoH8E6uKhsqsrzOoZwgg==',key_name='tempest-keypair-627413116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-zfoj5n1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=35f9ef3c-4dd4-431b-997c-7c0f91d035cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.objects.instance [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'pci_devices' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:06:36 user nova-compute[72000]:   <uuid>35f9ef3c-4dd4-431b-997c-7c0f91d035cd</uuid>
Aug 16 18:06:36 user nova-compute[72000]:   <name>instance-00000014</name>
Aug 16 18:06:36 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:06:36 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:06:36 user nova-compute[72000]:   <metadata>
Aug 16 18:06:36 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:06:36 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:06:36 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2067903681</nova:name>
Aug 16 18:06:36 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:06:36</nova:creationTime>
Aug 16 18:06:36 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:06:36 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:06:36 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:06:36 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:06:36 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:06:36 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:06:36 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:06:36 user nova-compute[72000]:       <nova:owner>
Aug 16 18:06:36 user nova-compute[72000]:         <nova:user uuid="135d5cc19e204a448036340be3ad519a">tempest-AttachVolumeShelveTestJSON-1660838105-project-member</nova:user>
Aug 16 18:06:36 user nova-compute[72000]:         <nova:project uuid="c7b0883d8fa04d16ba310cd8ce6dbaa4">tempest-AttachVolumeShelveTestJSON-1660838105</nova:project>
Aug 16 18:06:36 user nova-compute[72000]:       </nova:owner>
Aug 16 18:06:36 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:06:36 user nova-compute[72000]:       <nova:ports>
Aug 16 18:06:36 user nova-compute[72000]:         <nova:port uuid="570f94a4-3d2e-44e9-931f-147ee993a9e2">
Aug 16 18:06:36 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:06:36 user nova-compute[72000]:         </nova:port>
Aug 16 18:06:36 user nova-compute[72000]:       </nova:ports>
Aug 16 18:06:36 user nova-compute[72000]:     </nova:instance>
Aug 16 18:06:36 user nova-compute[72000]:   </metadata>
Aug 16 18:06:36 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:06:36 user nova-compute[72000]:     <system>
Aug 16 18:06:36 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:06:36 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:06:36 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:06:36 user nova-compute[72000]:       <entry name="serial">35f9ef3c-4dd4-431b-997c-7c0f91d035cd</entry>
Aug 16 18:06:36 user nova-compute[72000]:       <entry name="uuid">35f9ef3c-4dd4-431b-997c-7c0f91d035cd</entry>
Aug 16 18:06:36 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:06:36 user nova-compute[72000]:     </system>
Aug 16 18:06:36 user nova-compute[72000]:   </sysinfo>
Aug 16 18:06:36 user nova-compute[72000]:   <os>
Aug 16 18:06:36 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:06:36 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:06:36 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:06:36 user nova-compute[72000]:   </os>
Aug 16 18:06:36 user nova-compute[72000]:   <features>
Aug 16 18:06:36 user nova-compute[72000]:     <acpi/>
Aug 16 18:06:36 user nova-compute[72000]:     <apic/>
Aug 16 18:06:36 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:06:36 user nova-compute[72000]:   </features>
Aug 16 18:06:36 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:06:36 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:06:36 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:06:36 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:06:36 user nova-compute[72000]:   </clock>
Aug 16 18:06:36 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:06:36 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:06:36 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:06:36 user nova-compute[72000]:   </cpu>
Aug 16 18:06:36 user nova-compute[72000]:   <devices>
Aug 16 18:06:36 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:06:36 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:06:36 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk"/>
Aug 16 18:06:36 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:06:36 user nova-compute[72000]:     </disk>
Aug 16 18:06:36 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:06:36 user nova-compute[72000]:       <mac address="fa:16:3e:95:83:32"/>
Aug 16 18:06:36 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:06:36 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:06:36 user nova-compute[72000]:       <target dev="tap570f94a4-3d"/>
Aug 16 18:06:36 user nova-compute[72000]:     </interface>
Aug 16 18:06:36 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:06:36 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/console.log" append="off"/>
Aug 16 18:06:36 user nova-compute[72000]:     </serial>
Aug 16 18:06:36 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:06:36 user nova-compute[72000]:     <video>
Aug 16 18:06:36 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:06:36 user nova-compute[72000]:     </video>
Aug 16 18:06:36 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:06:36 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:06:36 user nova-compute[72000]:     </rng>
Aug 16 18:06:36 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:06:36 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:06:36 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:06:36 user nova-compute[72000]:     </memballoon>
Aug 16 18:06:36 user nova-compute[72000]:   </devices>
Aug 16 18:06:36 user nova-compute[72000]: </domain>
Aug 16 18:06:36 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2067903681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2067903681',id=20,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzAIQ4Qj/buGVYTF9Q5oTXmTmubqVmbfas/Gwlki1gZXYF6B7LxmZeceF68CptfGwnNe4ghrEiOtNYM248dcgGpuXQVyEeF0szdyiRkBTm+GkDoH8E6uKhsqsrzOoZwgg==',key_name='tempest-keypair-627413116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-zfoj5n1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=35f9ef3c-4dd4-431b-997c-7c0f91d035cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG os_vif [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap570f94a4-3d, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap570f94a4-3d, col_values=(('external_ids', {'iface-id': '570f94a4-3d2e-44e9-931f-147ee993a9e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:83:32', 'vm-uuid': '35f9ef3c-4dd4-431b-997c-7c0f91d035cd'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:36 user nova-compute[72000]: INFO os_vif [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d')
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] No VIF found with MAC fa:16:3e:95:83:32, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2495f245-d57d-4c83-b89d-b092ce78cb13 req-c21c35dc-9681-4cc0-af7d-5efbd864b061 service nova] Releasing lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-8367c1c7-60c5-4e93-a2a7-791031230ecf req-3c8416fa-1661-4865-9133-205bd5ae5d53 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updated VIF entry in instance network info cache for port 570f94a4-3d2e-44e9-931f-147ee993a9e2. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-8367c1c7-60c5-4e93-a2a7-791031230ecf req-3c8416fa-1661-4865-9133-205bd5ae5d53 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updating instance_info_cache with network_info: [{"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8367c1c7-60c5-4e93-a2a7-791031230ecf req-3c8416fa-1661-4865-9133-205bd5ae5d53 service nova] Releasing lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:36 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully updated port: 20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-changed-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing instance network info cache due to event network-changed-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] Acquiring lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] Acquired lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG nova.network.neutron [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing network info cache for port f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG nova.network.neutron [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:06:37 user nova-compute[72000]: DEBUG nova.network.neutron [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] Releasing lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-changed-20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing instance network info cache due to event network-changed-20f0c252-2401-4fd8-9811-ce038433d723. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] Acquiring lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] Acquired lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG nova.network.neutron [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing network info cache for port 20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG nova.network.neutron [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG nova.network.neutron [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa74fd68-ae78-4a76-bf73-ece5354fd7af req-5585bd70-b878-43bc-9e97-eccceb54b2f9 service nova] Releasing lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully updated port: 5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:06:39 user nova-compute[72000]: INFO nova.virt.block_device [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Booting with volume b080a215-fa47-44d3-a3e1-3ca6995d820e at /dev/vdb
Aug 16 18:06:39 user nova-compute[72000]: DEBUG os_brick.utils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e1d0a0-1d65-4b12-a7fb-c698f954a2ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[132d9fac-bca1-42aa-858d-d8eaf6a28f3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fd1a11-270f-4a34-8c2f-3337df135d1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ed4baa-016f-41dd-aada-5a93e234c938]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:06:39 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[beec5d31-751b-49e5-8623-f70b42bd332e]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG os_brick.utils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating existing volume attachment record: e3162b86-e081-4ebc-a9e2-5d2d6e17e777 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Successfully updated port: 8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquired lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'migration_context' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209199.631826, 35f9ef3c-4dd4-431b-997c-7c0f91d035cd => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:06:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] VM Resumed (Lifecycle Event)
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:06:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Instance spawned successfully.
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:06:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209199.6324759, 35f9ef3c-4dd4-431b-997c-7c0f91d035cd => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:06:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] VM Started (Lifecycle Event)
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:06:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] No waiting events found dispatching network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:39 user nova-compute[72000]: WARNING nova.compute.manager [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received unexpected event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 for instance with vm_state building and task_state spawning.
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-changed-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing instance network info cache due to event network-changed-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Acquiring lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.506s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:39 user nova-compute[72000]: INFO nova.compute.manager [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 16 18:06:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:39 user nova-compute[72000]: INFO nova.compute.manager [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Took 6.40 seconds to build instance.
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7ccd2b0e-cb6a-4c61-a5c5-dd4102a37899 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.513s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.160s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:39 user nova-compute[72000]: INFO nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:06:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:39 user nova-compute[72000]: INFO nova.compute.manager [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Swapping old allocation on dict_keys(['41d2d9e5-ac93-4703-9b48-d29797f5aeb9']) held by migration 03a9dd8d-4d9a-4244-b9fa-b8758ed333fd for instance
Aug 16 18:06:40 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Overwriting current allocation {'allocations': {'41d2d9e5-ac93-4703-9b48-d29797f5aeb9': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 25}}, 'project_id': 'df523a13c0914e4ea7c2782d10e6535c', 'user_id': '4bb202933952474c99d17811058efc7c', 'consumer_generation': 1} on consumer a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquired lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Releasing lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG os_brick.utils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9346fe5-7467-4d46-9ded-1a9eacdc46d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aaad59-4f35-452e-a5bf-9728b0c2088b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b648eaf9-55a6-4b16-9484-6ffa11fdfa3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5dad5b-a80b-49b6-b955-db8682a1f6ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:06:40 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:06:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b0e266-e803-4648-b96b-e051212197eb]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:06:40 user nova-compute[72000]: DEBUG os_brick.utils [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:06:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:41 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209186.536048, f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:06:41 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] VM Stopped (Lifecycle Event)
Aug 16 18:06:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5d0cd83d-37a2-4c8a-a52d-24dea79c2765 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5d0cd83d-37a2-4c8a-a52d-24dea79c2765 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:06:41 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [{"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Releasing lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Instance network_info: |[{"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:06:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Acquired lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing network info cache for port 5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG nova.network.neutron [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updated VIF entry in instance network info cache for port 5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG nova.network.neutron [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [{"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Releasing lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] No waiting events found dispatching network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:42 user nova-compute[72000]: WARNING nova.compute.manager [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received unexpected event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 for instance with vm_state building and task_state spawning.
Aug 16 18:06:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-changed-8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing instance network info cache due to event network-changed-8dae8097-fbe9-439d-a321-f7ef4e14b57a. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Acquiring lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Acquired lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG nova.network.neutron [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing network info cache for port 8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG nova.network.neutron [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updated VIF entry in instance network info cache for port 8dae8097-fbe9-439d-a321-f7ef4e14b57a. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG nova.network.neutron [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [{"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-54c51415-6bcf-4bf9-938d-3511f9abded2 req-498dfcf7-46fd-41d0-aefd-2704b42fa39a service nova] Releasing lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:45 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209190.9037545, a8532341-62b3-4c58-b3d8-db5440ad08c3 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:06:45 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] VM Stopped (Lifecycle Event)
Aug 16 18:06:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ad11aad5-bbd6-4068-890c-ebb4448d1bf3 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:50 user nova-compute[72000]: INFO nova.compute.manager [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Rescuing
Aug 16 18:06:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:06:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquired lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:06:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Updating instance_info_cache with network_info: [{"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Releasing lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-b9c013df-4475-4f33-b229-120f3cca4be6 req-2a8f9dfd-7343-4028-8df0-755c9429e4f3 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-vif-unplugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b9c013df-4475-4f33-b229-120f3cca4be6 req-2a8f9dfd-7343-4028-8df0-755c9429e4f3 service nova] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b9c013df-4475-4f33-b229-120f3cca4be6 req-2a8f9dfd-7343-4028-8df0-755c9429e4f3 service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b9c013df-4475-4f33-b229-120f3cca4be6 req-2a8f9dfd-7343-4028-8df0-755c9429e4f3 service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-b9c013df-4475-4f33-b229-120f3cca4be6 req-2a8f9dfd-7343-4028-8df0-755c9429e4f3 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] No waiting events found dispatching network-vif-unplugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:51 user nova-compute[72000]: WARNING nova.compute.manager [req-b9c013df-4475-4f33-b229-120f3cca4be6 req-2a8f9dfd-7343-4028-8df0-755c9429e4f3 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received unexpected event network-vif-unplugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf for instance with vm_state active and task_state rescuing.
Aug 16 18:06:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Instance destroyed successfully.
Aug 16 18:06:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Attempting rescue
Aug 16 18:06:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Instance directory exists: not creating {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 18:06:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Creating image(s)
Aug 16 18:06:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'trusted_certs' on Instance uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.167s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue" returned: 0 in 0.044s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'migration_context' on Instance uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Start _get_guest_xml network_info=[{"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "vif_mac": "fa:16:3e:18:cd:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'resources' on Instance uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'numa_topology' on Instance uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:52 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:06:52 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'vcpu_model' on Instance uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-698649144',display_name='tempest-ServerRescueNegativeTestJSON-server-698649144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-698649144',id=17,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-oj515vfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:05:10Z,user_data=None,user_id='d07d329987884ac98b87374ca2074b86',uuid=966d4480-7413-43bc-9b0f-6a522e88908b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "vif_mac": "fa:16:3e:18:cd:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "vif_mac": "fa:16:3e:18:cd:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f8881b-d1') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'pci_devices' on Instance uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:06:52 user nova-compute[72000]:   <uuid>966d4480-7413-43bc-9b0f-6a522e88908b</uuid>
Aug 16 18:06:52 user nova-compute[72000]:   <name>instance-00000011</name>
Aug 16 18:06:52 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:06:52 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:06:52 user nova-compute[72000]:   <metadata>
Aug 16 18:06:52 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:06:52 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:06:52 user nova-compute[72000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-698649144</nova:name>
Aug 16 18:06:52 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:06:52</nova:creationTime>
Aug 16 18:06:52 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:06:52 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:06:52 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:06:52 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:06:52 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:06:52 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:06:52 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:06:52 user nova-compute[72000]:       <nova:owner>
Aug 16 18:06:52 user nova-compute[72000]:         <nova:user uuid="d07d329987884ac98b87374ca2074b86">tempest-ServerRescueNegativeTestJSON-1605720785-project-member</nova:user>
Aug 16 18:06:52 user nova-compute[72000]:         <nova:project uuid="5442ba2319584631a81b2d1208b5f65f">tempest-ServerRescueNegativeTestJSON-1605720785</nova:project>
Aug 16 18:06:52 user nova-compute[72000]:       </nova:owner>
Aug 16 18:06:52 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:06:52 user nova-compute[72000]:       <nova:ports>
Aug 16 18:06:52 user nova-compute[72000]:         <nova:port uuid="f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf">
Aug 16 18:06:52 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 18:06:52 user nova-compute[72000]:         </nova:port>
Aug 16 18:06:52 user nova-compute[72000]:       </nova:ports>
Aug 16 18:06:52 user nova-compute[72000]:     </nova:instance>
Aug 16 18:06:52 user nova-compute[72000]:   </metadata>
Aug 16 18:06:52 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:06:52 user nova-compute[72000]:     <system>
Aug 16 18:06:52 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:06:52 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:06:52 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:06:52 user nova-compute[72000]:       <entry name="serial">966d4480-7413-43bc-9b0f-6a522e88908b</entry>
Aug 16 18:06:52 user nova-compute[72000]:       <entry name="uuid">966d4480-7413-43bc-9b0f-6a522e88908b</entry>
Aug 16 18:06:52 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:06:52 user nova-compute[72000]:     </system>
Aug 16 18:06:52 user nova-compute[72000]:   </sysinfo>
Aug 16 18:06:52 user nova-compute[72000]:   <os>
Aug 16 18:06:52 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:06:52 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:06:52 user nova-compute[72000]:   </os>
Aug 16 18:06:52 user nova-compute[72000]:   <features>
Aug 16 18:06:52 user nova-compute[72000]:     <acpi/>
Aug 16 18:06:52 user nova-compute[72000]:     <apic/>
Aug 16 18:06:52 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:06:52 user nova-compute[72000]:   </features>
Aug 16 18:06:52 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:06:52 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:06:52 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:06:52 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:06:52 user nova-compute[72000]:   </clock>
Aug 16 18:06:52 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:06:52 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:06:52 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:06:52 user nova-compute[72000]:   </cpu>
Aug 16 18:06:52 user nova-compute[72000]:   <devices>
Aug 16 18:06:52 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:06:52 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:06:52 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue"/>
Aug 16 18:06:52 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:06:52 user nova-compute[72000]:     </disk>
Aug 16 18:06:52 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:06:52 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:06:52 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk"/>
Aug 16 18:06:52 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:06:52 user nova-compute[72000]:     </disk>
Aug 16 18:06:52 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:06:52 user nova-compute[72000]:       <mac address="fa:16:3e:18:cd:11"/>
Aug 16 18:06:52 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:06:52 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:06:52 user nova-compute[72000]:       <target dev="tapf6f8881b-d1"/>
Aug 16 18:06:52 user nova-compute[72000]:     </interface>
Aug 16 18:06:52 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:06:52 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/console.log" append="off"/>
Aug 16 18:06:52 user nova-compute[72000]:     </serial>
Aug 16 18:06:52 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:06:52 user nova-compute[72000]:     <video>
Aug 16 18:06:52 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:06:52 user nova-compute[72000]:     </video>
Aug 16 18:06:52 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:06:52 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:06:52 user nova-compute[72000]:     </rng>
Aug 16 18:06:52 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:06:52 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:06:52 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:06:52 user nova-compute[72000]:     </memballoon>
Aug 16 18:06:52 user nova-compute[72000]:   </devices>
Aug 16 18:06:52 user nova-compute[72000]: </domain>
Aug 16 18:06:52 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:06:52 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Instance destroyed successfully.
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:06:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No VIF found with MAC fa:16:3e:18:cd:11, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:53 user nova-compute[72000]: INFO nova.virt.block_device [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Booting with volume 785e7214-45bc-4d8e-b8fe-351099f6fa36 at /dev/vdc
Aug 16 18:06:53 user nova-compute[72000]: DEBUG os_brick.utils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[400040b9-de8d-4548-bbf6-89a6a3101205]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a8f216-e598-4132-b7d2-36ba41050b79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fc7390-3350-42f4-bf40-b9b5a6e782d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a1cd4-33a0-4ab7-8999-d7243c50e91d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-a656163f-1c17-440c-bccb-e20334bc4a0d req-ab0b5b23-349e-49b3-b751-7970bd6af6fb service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a656163f-1c17-440c-bccb-e20334bc4a0d req-ab0b5b23-349e-49b3-b751-7970bd6af6fb service nova] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a656163f-1c17-440c-bccb-e20334bc4a0d req-ab0b5b23-349e-49b3-b751-7970bd6af6fb service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a656163f-1c17-440c-bccb-e20334bc4a0d req-ab0b5b23-349e-49b3-b751-7970bd6af6fb service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-a656163f-1c17-440c-bccb-e20334bc4a0d req-ab0b5b23-349e-49b3-b751-7970bd6af6fb service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] No waiting events found dispatching network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:53 user nova-compute[72000]: WARNING nova.compute.manager [req-a656163f-1c17-440c-bccb-e20334bc4a0d req-ab0b5b23-349e-49b3-b751-7970bd6af6fb service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received unexpected event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf for instance with vm_state active and task_state rescuing.
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:06:53 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:06:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfd1160-f1b7-4f5b-a59a-2ba9f70ad809]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG os_brick.utils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] <== get_connector_properties: return (435ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating existing volume attachment record: 57d9e1b2-ba32-407a-af96-71a459d0391d {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] No waiting events found dispatching network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:55 user nova-compute[72000]: WARNING nova.compute.manager [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received unexpected event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf for instance with vm_state active and task_state rescuing.
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] No waiting events found dispatching network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:06:55 user nova-compute[72000]: WARNING nova.compute.manager [req-d5a7be21-b111-4160-9263-7ced51b0e797 req-09b8a760-b27d-4547-941d-534bef059f93 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received unexpected event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf for instance with vm_state active and task_state rescuing.
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for 966d4480-7413-43bc-9b0f-6a522e88908b due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209215.6969507, 966d4480-7413-43bc-9b0f-6a522e88908b => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:06:55 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] VM Resumed (Lifecycle Event)
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3b97a1e2-651b-46a1-a14f-1620cb4cd514 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:06:55 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209215.69766, 966d4480-7413-43bc-9b0f-6a522e88908b => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:06:55 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] VM Started (Lifecycle Event)
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:06:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:06:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Starting finish_revert_migration {{(pid=72000) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Start _get_guest_xml network_info=[{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a8532341-62b3-4c58-b3d8-db5440ad08c3', 'attached_at': '2023-08-16T18:07:02.000000', 'detached_at': '', 'volume_id': '5a3bba8f-57f3-428b-87f7-c48a475f84fa', 'serial': '5a3bba8f-57f3-428b-87f7-c48a475f84fa'}, 'attachment_id': '875c24ef-2c92-41f4-9cc7-610c685ac873', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:07:01 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:07:01 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.objects.instance [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:07:01 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:01 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:01 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5110559-b415-4784-b671-1bf689e25dcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:07:01 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba97da65-40e6-40da-b919-3302e4f9211d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa] added
Aug 16 18:07:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[158fe67b-5bad-4468-aee9-8794286975f3]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4490491d-5b57-4148-a3c7-e3cc31e46834]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmFWTNRU {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmFWTNRU" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[daadad21-5cc2-4fc8-9c02-31a9c34870f4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kmFWTNRU'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f79c10b-3ae8-4826-bfdf-7bf19feaa3c7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ddf763-01e3-4ce2-aa6a-178a68c6c0d2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:07:02 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:07:02 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:07:02 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:07:02 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c00ee19-ae2f-42da-aeb9-377041259e9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]
Aug 16 18:07:02 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.
Aug 16 18:07:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33294c6-fb0c-4110-a007-f3031e9fa247]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b641af-697b-4206-8cae-11abf4af68e7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:07:02 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:07:02 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:02 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:07:02 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:07:02 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:02 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[016c90a4-859f-4978-ab19-c32eb6c47a46]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:07:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23664623034313762', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664623034313762', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-158489387',display_name='tempest-ServerActionsTestOtherB-server-158489387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-158489387',id=4,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrdiqOjF0w82oTGC6W8NyzHji/AAi+fARuYFDptSsxWEW2f7mWefGKfWyQtISbWHzqnq0YFbbPnDR8XKw6XPCJva4Yjg8+O3HxmlUuJZCmEJf2X0VZ0VVhtvx/qeQ8XoQ==',key_name='tempest-keypair-1407087314',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df523a13c0914e4ea7c2782d10e6535c',ramdisk_id='',reservation_id='r-hdgm4kha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915732487',owner_user_name='tempest-ServerActionsTestOtherB-915732487-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb202933952474c99d17811058efc7c',uuid=a8532341-62b3-4c58-b3d8-db5440ad08c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converting VIF {"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:07:03 user nova-compute[72000]:   <uuid>a8532341-62b3-4c58-b3d8-db5440ad08c3</uuid>
Aug 16 18:07:03 user nova-compute[72000]:   <name>instance-00000004</name>
Aug 16 18:07:03 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:07:03 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:07:03 user nova-compute[72000]:   <metadata>
Aug 16 18:07:03 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:07:03 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:07:03 user nova-compute[72000]:       <nova:name>tempest-ServerActionsTestOtherB-server-158489387</nova:name>
Aug 16 18:07:03 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:07:01</nova:creationTime>
Aug 16 18:07:03 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:07:03 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:07:03 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:07:03 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:07:03 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:07:03 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:07:03 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:07:03 user nova-compute[72000]:       <nova:owner>
Aug 16 18:07:03 user nova-compute[72000]:         <nova:user uuid="4bb202933952474c99d17811058efc7c">tempest-ServerActionsTestOtherB-915732487-project-member</nova:user>
Aug 16 18:07:03 user nova-compute[72000]:         <nova:project uuid="df523a13c0914e4ea7c2782d10e6535c">tempest-ServerActionsTestOtherB-915732487</nova:project>
Aug 16 18:07:03 user nova-compute[72000]:       </nova:owner>
Aug 16 18:07:03 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:07:03 user nova-compute[72000]:       <nova:ports>
Aug 16 18:07:03 user nova-compute[72000]:         <nova:port uuid="548341b0-47da-4962-b21a-fd4cc4118bdc">
Aug 16 18:07:03 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 18:07:03 user nova-compute[72000]:         </nova:port>
Aug 16 18:07:03 user nova-compute[72000]:       </nova:ports>
Aug 16 18:07:03 user nova-compute[72000]:     </nova:instance>
Aug 16 18:07:03 user nova-compute[72000]:   </metadata>
Aug 16 18:07:03 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:07:03 user nova-compute[72000]:     <system>
Aug 16 18:07:03 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:07:03 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:07:03 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:07:03 user nova-compute[72000]:       <entry name="serial">a8532341-62b3-4c58-b3d8-db5440ad08c3</entry>
Aug 16 18:07:03 user nova-compute[72000]:       <entry name="uuid">a8532341-62b3-4c58-b3d8-db5440ad08c3</entry>
Aug 16 18:07:03 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:07:03 user nova-compute[72000]:     </system>
Aug 16 18:07:03 user nova-compute[72000]:   </sysinfo>
Aug 16 18:07:03 user nova-compute[72000]:   <os>
Aug 16 18:07:03 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:07:03 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:07:03 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:07:03 user nova-compute[72000]:   </os>
Aug 16 18:07:03 user nova-compute[72000]:   <features>
Aug 16 18:07:03 user nova-compute[72000]:     <acpi/>
Aug 16 18:07:03 user nova-compute[72000]:     <apic/>
Aug 16 18:07:03 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:07:03 user nova-compute[72000]:   </features>
Aug 16 18:07:03 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:07:03 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:07:03 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:07:03 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:07:03 user nova-compute[72000]:   </clock>
Aug 16 18:07:03 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:07:03 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:07:03 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:07:03 user nova-compute[72000]:   </cpu>
Aug 16 18:07:03 user nova-compute[72000]:   <devices>
Aug 16 18:07:03 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:07:03 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:07:03 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk"/>
Aug 16 18:07:03 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:07:03 user nova-compute[72000]:     </disk>
Aug 16 18:07:03 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:07:03 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:07:03 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 18:07:03 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:07:03 user nova-compute[72000]:       <serial>5a3bba8f-57f3-428b-87f7-c48a475f84fa</serial>
Aug 16 18:07:03 user nova-compute[72000]:     </disk>
Aug 16 18:07:03 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:07:03 user nova-compute[72000]:       <mac address="fa:16:3e:98:69:d9"/>
Aug 16 18:07:03 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:03 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:07:03 user nova-compute[72000]:       <target dev="tap548341b0-47"/>
Aug 16 18:07:03 user nova-compute[72000]:     </interface>
Aug 16 18:07:03 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:07:03 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/console.log" append="off"/>
Aug 16 18:07:03 user nova-compute[72000]:     </serial>
Aug 16 18:07:03 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:07:03 user nova-compute[72000]:     <video>
Aug 16 18:07:03 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:03 user nova-compute[72000]:     </video>
Aug 16 18:07:03 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:07:03 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:07:03 user nova-compute[72000]:     </rng>
Aug 16 18:07:03 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:07:03 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:07:03 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:07:03 user nova-compute[72000]:     </memballoon>
Aug 16 18:07:03 user nova-compute[72000]:   </devices>
Aug 16 18:07:03 user nova-compute[72000]: </domain>
Aug 16 18:07:03 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-158489387',display_name='tempest-ServerActionsTestOtherB-server-158489387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-158489387',id=4,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrdiqOjF0w82oTGC6W8NyzHji/AAi+fARuYFDptSsxWEW2f7mWefGKfWyQtISbWHzqnq0YFbbPnDR8XKw6XPCJva4Yjg8+O3HxmlUuJZCmEJf2X0VZ0VVhtvx/qeQ8XoQ==',key_name='tempest-keypair-1407087314',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='df523a13c0914e4ea7c2782d10e6535c',ramdisk_id='',reservation_id='r-hdgm4kha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-915732487',owner_user_name='tempest-ServerActionsTestOtherB-915732487-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb202933952474c99d17811058efc7c',uuid=a8532341-62b3-4c58-b3d8-db5440ad08c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converting VIF {"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG os_vif [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap548341b0-47, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap548341b0-47, col_values=(('external_ids', {'iface-id': '548341b0-47da-4962-b21a-fd4cc4118bdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:69:d9', 'vm-uuid': 'a8532341-62b3-4c58-b3d8-db5440ad08c3'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:03 user nova-compute[72000]: INFO os_vif [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47')
Aug 16 18:07:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-8bbdef5e-5b36-4303-9659-cd45573e3dc3 req-d58d568c-4951-4a9d-abc0-ae385ddc2bb2 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8bbdef5e-5b36-4303-9659-cd45573e3dc3 req-d58d568c-4951-4a9d-abc0-ae385ddc2bb2 service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8bbdef5e-5b36-4303-9659-cd45573e3dc3 req-d58d568c-4951-4a9d-abc0-ae385ddc2bb2 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8bbdef5e-5b36-4303-9659-cd45573e3dc3 req-d58d568c-4951-4a9d-abc0-ae385ddc2bb2 service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-8bbdef5e-5b36-4303-9659-cd45573e3dc3 req-d58d568c-4951-4a9d-abc0-ae385ddc2bb2 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:04 user nova-compute[72000]: WARNING nova.compute.manager [req-8bbdef5e-5b36-4303-9659-cd45573e3dc3 req-d58d568c-4951-4a9d-abc0-ae385ddc2bb2 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state resized and task_state resize_reverting.
Aug 16 18:07:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:05 user nova-compute[72000]: INFO nova.compute.manager [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Terminating instance
Aug 16 18:07:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Instance destroyed successfully.
Aug 16 18:07:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lazy-loading 'resources' on Instance uuid b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-980540578',display_name='tempest-VolumesAdminNegativeTest-server-980540578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-980540578',id=7,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA/hvzt2Xh/5vjNJ5rw9TTlIFEn6CMi/PeB5dBzOMRW8SF/ewmX6eNapygm9Hj/JkkCcwxJvmctOR5ho+vVE3Ip69YZ775WexSUdrvPfd1NtVZAj+zCpKFCCehCxduAtg==',key_name='tempest-keypair-1302893124',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ad509a974084c17ac6ffac36ca72c50',ramdisk_id='',reservation_id='r-pv0rfu3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-127684415',owner_user_name='tempest-VolumesAdminNegativeTest-127684415-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='090a1c872b734d0bb3daede325eca0df',uuid=b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converting VIF {"id": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "address": "fa:16:3e:70:dd:99", "network": {"id": "513def4a-c1d8-49cd-b462-725eeeac967d", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1470185172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ad509a974084c17ac6ffac36ca72c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bbf38dc-26", "ovs_interfaceid": "1bbf38dc-2654-4e85-9dd9-000af10e5c3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=1bbf38dc-2654-4e85-9dd9-000af10e5c3f,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bbf38dc-26') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG os_vif [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=1bbf38dc-2654-4e85-9dd9-000af10e5c3f,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bbf38dc-26') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bbf38dc-26, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:06 user nova-compute[72000]: INFO os_vif [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=1bbf38dc-2654-4e85-9dd9-000af10e5c3f,network=Network(513def4a-c1d8-49cd-b462-725eeeac967d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bbf38dc-26')
Aug 16 18:07:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Deleting instance files /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212_del
Aug 16 18:07:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Deletion of /opt/stack/data/nova/instances/b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212_del complete
Aug 16 18:07:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:07 user nova-compute[72000]: INFO nova.compute.manager [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Took 1.06 seconds to destroy the instance on the hypervisor.
Aug 16 18:07:07 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:07 user nova-compute[72000]: WARNING nova.compute.manager [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state resized and task_state resize_reverting.
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-vif-unplugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] No waiting events found dispatching network-vif-unplugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-vif-unplugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] No waiting events found dispatching network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:07 user nova-compute[72000]: WARNING nova.compute.manager [req-fac288b4-3ec8-490b-990c-eebecf378645 req-9db37112-82c4-48ae-aba2-7f76b293c69a service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received unexpected event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f for instance with vm_state active and task_state deleting.
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209227.1250753, a8532341-62b3-4c58-b3d8-db5440ad08c3 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:07:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] VM Resumed (Lifecycle Event)
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:07:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance running successfully.
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] finish_revert_migration finished successfully. {{(pid=72000) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:07:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209227.1267185, a8532341-62b3-4c58-b3d8-db5440ad08c3 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:07:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] VM Started (Lifecycle Event)
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:07:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 16 18:07:07 user nova-compute[72000]: INFO nova.compute.manager [None req-6de15f1c-9929-4cf0-884a-409a6f73fb6e tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance to original state: 'active'
Aug 16 18:07:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:08 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:08 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Took 1.21 seconds to deallocate network for instance.
Aug 16 18:07:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-2185b46b-9360-4387-ade6-cca634146354 req-f721c2cf-afab-4787-9435-39e84599bed1 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-vif-deleted-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:08 user nova-compute[72000]: INFO nova.compute.manager [req-2185b46b-9360-4387-ade6-cca634146354 req-f721c2cf-afab-4787-9435-39e84599bed1 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Neutron deleted interface 1bbf38dc-2654-4e85-9dd9-000af10e5c3f; detaching it from the instance and deleting it from the info cache
Aug 16 18:07:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-2185b46b-9360-4387-ade6-cca634146354 req-f721c2cf-afab-4787-9435-39e84599bed1 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-2185b46b-9360-4387-ade6-cca634146354 req-f721c2cf-afab-4787-9435-39e84599bed1 service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Detach interface failed, port_id=1bbf38dc-2654-4e85-9dd9-000af10e5c3f, reason: Instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:07:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:08 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:07:08 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:07:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:08 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Deleted allocations for instance b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212
Aug 16 18:07:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-002cda06-dbb7-4931-89d2-aa19c08944cf tempest-VolumesAdminNegativeTest-127684415 tempest-VolumesAdminNegativeTest-127684415-project-member] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.944s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] No waiting events found dispatching network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:09 user nova-compute[72000]: WARNING nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received unexpected event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f for instance with vm_state deleted and task_state None.
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] No waiting events found dispatching network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:09 user nova-compute[72000]: WARNING nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received unexpected event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f for instance with vm_state deleted and task_state None.
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-vif-unplugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] No waiting events found dispatching network-vif-unplugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:09 user nova-compute[72000]: WARNING nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received unexpected event network-vif-unplugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f for instance with vm_state deleted and task_state None.
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Acquiring lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] Lock "b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] No waiting events found dispatching network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:09 user nova-compute[72000]: WARNING nova.compute.manager [req-cd30275d-2d8d-4d0b-b65f-956dd97261d9 req-c67c23f8-a67f-4ec9-8ec5-9bab4c28924e service nova] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Received unexpected event network-vif-plugged-1bbf38dc-2654-4e85-9dd9-000af10e5c3f for instance with vm_state deleted and task_state None.
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-3d0b1975-f8a4-4084-909a-620fd4c4025f req-35bdeb6b-143f-443d-8c9f-92be558a1849 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-changed-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-3d0b1975-f8a4-4084-909a-620fd4c4025f req-35bdeb6b-143f-443d-8c9f-92be558a1849 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing instance network info cache due to event network-changed-de767d0a-0b30-40a6-9215-7e4f76277f78. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d0b1975-f8a4-4084-909a-620fd4c4025f req-35bdeb6b-143f-443d-8c9f-92be558a1849 service nova] Acquiring lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d0b1975-f8a4-4084-909a-620fd4c4025f req-35bdeb6b-143f-443d-8c9f-92be558a1849 service nova] Acquired lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.network.neutron [req-3d0b1975-f8a4-4084-909a-620fd4c4025f req-35bdeb6b-143f-443d-8c9f-92be558a1849 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Refreshing network info cache for port de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.network.neutron [req-3d0b1975-f8a4-4084-909a-620fd4c4025f req-35bdeb6b-143f-443d-8c9f-92be558a1849 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updated VIF entry in instance network info cache for port de767d0a-0b30-40a6-9215-7e4f76277f78. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG nova.network.neutron [req-3d0b1975-f8a4-4084-909a-620fd4c4025f req-35bdeb6b-143f-443d-8c9f-92be558a1849 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [{"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3d0b1975-f8a4-4084-909a-620fd4c4025f req-35bdeb6b-143f-443d-8c9f-92be558a1849 service nova] Releasing lock "refresh_cache-b22234a2-c9cb-4a04-856c-ef718c80e59d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:07:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:07:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:12 user nova-compute[72000]: INFO nova.compute.manager [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Terminating instance
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-daac7867-534f-4bba-8981-48d210c2c8ea req-c2087cba-9424-484f-9fc3-0dd067d90537 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-daac7867-534f-4bba-8981-48d210c2c8ea req-c2087cba-9424-484f-9fc3-0dd067d90537 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-daac7867-534f-4bba-8981-48d210c2c8ea req-c2087cba-9424-484f-9fc3-0dd067d90537 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-daac7867-534f-4bba-8981-48d210c2c8ea req-c2087cba-9424-484f-9fc3-0dd067d90537 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-daac7867-534f-4bba-8981-48d210c2c8ea req-c2087cba-9424-484f-9fc3-0dd067d90537 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-unplugged-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-daac7867-534f-4bba-8981-48d210c2c8ea req-c2087cba-9424-484f-9fc3-0dd067d90537 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-de767d0a-0b30-40a6-9215-7e4f76277f78 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-d4651de1-bc83-4179-b636-4ace875ccc28 req-7a4d0b18-fcde-46d4-8f34-667e687bf9ed service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d4651de1-bc83-4179-b636-4ace875ccc28 req-7a4d0b18-fcde-46d4-8f34-667e687bf9ed service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d4651de1-bc83-4179-b636-4ace875ccc28 req-7a4d0b18-fcde-46d4-8f34-667e687bf9ed service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d4651de1-bc83-4179-b636-4ace875ccc28 req-7a4d0b18-fcde-46d4-8f34-667e687bf9ed service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-d4651de1-bc83-4179-b636-4ace875ccc28 req-7a4d0b18-fcde-46d4-8f34-667e687bf9ed service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-unplugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-d4651de1-bc83-4179-b636-4ace875ccc28 req-7a4d0b18-fcde-46d4-8f34-667e687bf9ed service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-703c91b4-08cf-4982-a0b4-847308f2a0e4 req-9dcc8ae9-db0d-4ef3-9e7d-340db48892d4 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-703c91b4-08cf-4982-a0b4-847308f2a0e4 req-9dcc8ae9-db0d-4ef3-9e7d-340db48892d4 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-703c91b4-08cf-4982-a0b4-847308f2a0e4 req-9dcc8ae9-db0d-4ef3-9e7d-340db48892d4 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-703c91b4-08cf-4982-a0b4-847308f2a0e4 req-9dcc8ae9-db0d-4ef3-9e7d-340db48892d4 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-703c91b4-08cf-4982-a0b4-847308f2a0e4 req-9dcc8ae9-db0d-4ef3-9e7d-340db48892d4 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-unplugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-703c91b4-08cf-4982-a0b4-847308f2a0e4 req-9dcc8ae9-db0d-4ef3-9e7d-340db48892d4 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Updating instance_info_cache with network_info: [{"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:07:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Instance destroyed successfully.
Aug 16 18:07:13 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lazy-loading 'resources' on Instance uuid b22234a2-c9cb-4a04-856c-ef718c80e59d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:ea:a1,bridge_name='br-int',has_traffic_filtering=True,id=de767d0a-0b30-40a6-9215-7e4f76277f78,network=Network(9b257c2f-c837-4feb-a93c-d098b6fb8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde767d0a-0b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:ea:a1,bridge_name='br-int',has_traffic_filtering=True,id=de767d0a-0b30-40a6-9215-7e4f76277f78,network=Network(9b257c2f-c837-4feb-a93c-d098b6fb8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde767d0a-0b') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde767d0a-0b, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: INFO os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:ea:a1,bridge_name='br-int',has_traffic_filtering=True,id=de767d0a-0b30-40a6-9215-7e4f76277f78,network=Network(9b257c2f-c837-4feb-a93c-d098b6fb8ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde767d0a-0b')
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:77,bridge_name='br-int',has_traffic_filtering=True,id=51aa08bd-5170-4234-8c91-07df0fa81bc5,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51aa08bd-51') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:77,bridge_name='br-int',has_traffic_filtering=True,id=51aa08bd-5170-4234-8c91-07df0fa81bc5,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51aa08bd-51') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51aa08bd-51, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: INFO os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:b0:77,bridge_name='br-int',has_traffic_filtering=True,id=51aa08bd-5170-4234-8c91-07df0fa81bc5,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51aa08bd-51')
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:67:a2,bridge_name='br-int',has_traffic_filtering=True,id=7e8000ae-52d9-4a24-ad5c-f6a80cca8210,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8000ae-52') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:67:a2,bridge_name='br-int',has_traffic_filtering=True,id=7e8000ae-52d9-4a24-ad5c-f6a80cca8210,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8000ae-52') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e8000ae-52, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: INFO os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:67:a2,bridge_name='br-int',has_traffic_filtering=True,id=7e8000ae-52d9-4a24-ad5c-f6a80cca8210,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e8000ae-52')
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "06896619-5181-4031-8206-fa030b712f6f", "address": "fa:16:3e:81:35:99", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06896619-51", "ovs_interfaceid": "06896619-5181-4031-8206-fa030b712f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:99,bridge_name='br-int',has_traffic_filtering=True,id=06896619-5181-4031-8206-fa030b712f6f,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06896619-51') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:99,bridge_name='br-int',has_traffic_filtering=True,id=06896619-5181-4031-8206-fa030b712f6f,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06896619-51') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06896619-51, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: INFO os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:35:99,bridge_name='br-int',has_traffic_filtering=True,id=06896619-5181-4031-8206-fa030b712f6f,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06896619-51')
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:17:72,bridge_name='br-int',has_traffic_filtering=True,id=4054e387-560a-4992-b0e5-733ff789f2f1,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4054e387-56') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:17:72,bridge_name='br-int',has_traffic_filtering=True,id=4054e387-560a-4992-b0e5-733ff789f2f1,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4054e387-56') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4054e387-56, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: INFO os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:17:72,bridge_name='br-int',has_traffic_filtering=True,id=4054e387-560a-4992-b0e5-733ff789f2f1,network=Network(52d18b62-3827-4ad8-88b3-c11be5e0a1b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4054e387-56')
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:19:3a,bridge_name='br-int',has_traffic_filtering=True,id=92e457e9-4656-4c5f-b1a4-dba3b27f7ac8,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e457e9-46') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:19:3a,bridge_name='br-int',has_traffic_filtering=True,id=92e457e9-4656-4c5f-b1a4-dba3b27f7ac8,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e457e9-46') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92e457e9-46, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: INFO os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:19:3a,bridge_name='br-int',has_traffic_filtering=True,id=92e457e9-4656-4c5f-b1a4-dba3b27f7ac8,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e457e9-46')
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-192007662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-192007662',id=15,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMTHqaxHDqjPsUe/tFwARsEZCA2KWcWX04Mm0cb7AtE4WjmL1qiQLdoZWMAgQtZYuX0T0Qvrm7wimfToy5+6tHpUBhCvYEIaEEi80CuvxNNmfjKVko52vhRb2DL6o1l0Q==',key_name='tempest-keypair-1753714691',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de0840edb5e14cfd82ab75d5c09b8d21',ramdisk_id='',reservation_id='r-0k75xckf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1668389145',owner_user_name='tempest-TaggedBootDevicesTest_v242-1668389145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbad49bffa64e649334499d2f3368e4',uuid=b22234a2-c9cb-4a04-856c-ef718c80e59d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converting VIF {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f2:67,bridge_name='br-int',has_traffic_filtering=True,id=74222f6d-fc28-4ae3-a554-d60f2dce0c57,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74222f6d-fc') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f2:67,bridge_name='br-int',has_traffic_filtering=True,id=74222f6d-fc28-4ae3-a554-d60f2dce0c57,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74222f6d-fc') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74222f6d-fc, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:14 user nova-compute[72000]: INFO os_vif [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f2:67,bridge_name='br-int',has_traffic_filtering=True,id=74222f6d-fc28-4ae3-a554-d60f2dce0c57,network=Network(ebdde453-eb51-4eb0-a681-e366e28af0e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74222f6d-fc')
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVSABnsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:07:14 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80e1492-b7d8-4edd-9916-1ceb5ad793b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d59ec79-4e77-4e2c-8d4a-1874b860fa7c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:07:14 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:07:14 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:14 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f (non-flash)
Aug 16 18:07:14 user nova-compute[72000]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:07:14 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:14 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd019d36560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f'): ({'sde'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Removing single pathed devices sde {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec98ebc-c13d-410c-8a08-700feb678cc2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:14 user nova-compute[72000]: WARNING nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-de767d0a-0b30-40a6-9215-7e4f76277f78 for instance with vm_state active and task_state deleting.
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-unplugged-06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-06896619-5181-4031-8206-fa030b712f6f for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:14 user nova-compute[72000]: WARNING nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-06896619-5181-4031-8206-fa030b712f6f for instance with vm_state active and task_state deleting.
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-unplugged-4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-cac0ee87-c265-438a-a749-72d864323d1b req-af743454-d2a8-4d20-bad2-c9d94f42546f service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-4054e387-560a-4992-b0e5-733ff789f2f1 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c1954c-fc0a-4090-a6ed-721417c47f28]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:14 user nova-compute[72000]: WARNING nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-51aa08bd-5170-4234-8c91-07df0fa81bc5 for instance with vm_state active and task_state deleting.
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-unplugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:14 user nova-compute[72000]: WARNING nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-7e8000ae-52d9-4a24-ad5c-f6a80cca8210 for instance with vm_state active and task_state deleting.
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-unplugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-unplugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:14 user nova-compute[72000]: WARNING nova.compute.manager [req-e6472d39-3520-444d-9928-9fca597ec3aa req-4fff5680-2830-4b40-a446-f3fc86c3cd32 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-74222f6d-fc28-4ae3-a554-d60f2dce0c57 for instance with vm_state active and task_state deleting.
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Flushing IO for device /dev/sde {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29d91aa-4298-4b64-873b-d2fabcac1c8d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.067s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad07798-76c5-41e9-bca6-edbd28fa4c0d]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c787258d-d3fb-40bc-82a2-655e4b589db4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0189d7c-dff1-4d33-98d7-81d75d8844e7]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f, portal: 172.16.0.220,3260]
Aug 16 18:07:14 user nova-compute[72000]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f, portal: 172.16.0.220,3260] successful.
Aug 16 18:07:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef07e040-562f-46e2-b532-6cc060f4931f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[45149aef-826c-4d0b-bd72-a99e6a269b1d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] <== disconnect_volume: return (417ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amOYTADj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:07:14 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:07:14 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Creating image(s)
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Ensure instance console log exists: /opt/stack/data/nova/instances/d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Start _get_guest_xml network_info=[{"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLHiIDBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7', 'attached_at': '', 'detached_at': '', 'volume_id': '6c3cc35d-082a-456a-982b-5d9e3e5a4ac5', 'serial': '6c3cc35d-082a-456a-982b-5d9e3e5a4ac5'}, 'attachment_id': '57cbe97a-d7f9-4fe7-be17-d412790e76ec', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiVZcTWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b080a215-fa47-44d3-a3e1-3ca6995d820e', 'serial': 'b080a215-fa47-44d3-a3e1-3ca6995d820e'}, 'attachment_id': 'e3162b86-e081-4ebc-a9e2-5d2d6e17e777', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcgtjbPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7', 'attached_at': '', 'detached_at': '', 'volume_id': '785e7214-45bc-4d8e-b8fe-351099f6fa36', 'serial': '785e7214-45bc-4d8e-b8fe-351099f6fa36'}, 'attachment_id': '57d9e1b2-ba32-407a-af96-71a459d0391d', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[24789de0-7169-4d32-acba-5f83387cf3f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:14 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:07:14 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLHiIDBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:07:14 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[241b8f4f-f165-48c4-b3e8-8913893e2978]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:07:14 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:14 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 (non-flash)
Aug 16 18:07:14 user nova-compute[72000]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:14 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0082ed2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0'): ({'sdf'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Removing single pathed devices sdf {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:07:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c380d5ea-9ca5-4600-bb36-db50fe9ffbdf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dd46b5-45a4-4a80-a55c-b6ae1294e2f4]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Flushing IO for device /dev/sdf {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-b4e470a5-2647-4af5-ad69-50cca199ac9f req-b0895705-72ca-46e0-85a6-6e1e2424609e service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b4e470a5-2647-4af5-ad69-50cca199ac9f req-b0895705-72ca-46e0-85a6-6e1e2424609e service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b4e470a5-2647-4af5-ad69-50cca199ac9f req-b0895705-72ca-46e0-85a6-6e1e2424609e service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b4e470a5-2647-4af5-ad69-50cca199ac9f req-b0895705-72ca-46e0-85a6-6e1e2424609e service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-b4e470a5-2647-4af5-ad69-50cca199ac9f req-b0895705-72ca-46e0-85a6-6e1e2424609e service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:15 user nova-compute[72000]: WARNING nova.compute.manager [req-b4e470a5-2647-4af5-ad69-50cca199ac9f req-b0895705-72ca-46e0-85a6-6e1e2424609e service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 for instance with vm_state active and task_state deleting.
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abab825-4161-4830-baad-182250d99f54]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e20637-39e7-4043-8557-6ae9a8e90979]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] SCSI volumes sdf have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eca919-d319-4fc3-bdc3-c345743c0966]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b717681d-54d6-4e74-8e0f-e3380aa93f2e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0, portal: 172.16.0.220,3260]
Aug 16 18:07:15 user nova-compute[72000]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0, portal: 172.16.0.220,3260] successful.
Aug 16 18:07:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74034cb7-6538-4acd-bfbc-8216ef5a81f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d958c5f-4d99-43ab-9c3a-b058d7fc54f3]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] <== disconnect_volume: return (361ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.264s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:15 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:15 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMpNlqcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:07:15 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dea745-da6e-487a-8d39-c134bfeac217]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:07:15 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb2c177-96c1-4b86-a8b5-aa9a494c310b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5] added
Aug 16 18:07:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d12708-fe54-43f2-8da2-6483beb78300]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d503dd41-8271-4aa3-a109-1b0cb474323f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vLHiIDBR {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vLHiIDBR" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eacb6a4-d4e7-4846-b20a-0d08dd1953af]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vLHiIDBR'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0285e3bc-971d-41e6-8297-f3ef33f4a559]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e10409a-486f-4254-9c98-e5ec60e852c5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:15 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:15 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f0eac3-cc32-45e6-a40d-6443c9d7bc29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5, portal: 172.16.0.220,3260]
Aug 16 18:07:15 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5, portal: 172.16.0.220,3260] successful.
Aug 16 18:07:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc96eeb7-b5c4-49e8-af04-5d2bfd7d687f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6280d884-db29-484a-b5f1-0051d0b27bf6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:15 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:15 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:15 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:15 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53cb45b-df8e-4367-af26-8ebb9a479876]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLHiIDBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] <== connect_volume: return (1611ms) {'type': 'block', 'scsi_wwn': '26239346332366166', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239346332366166', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.339s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f95e6be-12be-486b-bac4-20c237b46484]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiVZcTWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:07:16 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3ad95d-6369-44f1-a374-6c560b933f0d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:16 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:16 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 (non-flash)
Aug 16 18:07:16 user nova-compute[72000]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:16 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01c85ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83'): ({'sdg'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Removing single pathed devices sdg {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-57aaa1b4-3f06-451c-9ee8-1970f70c2da7 req-6db71c92-53ae-4370-85cd-d0d6e404f7dc service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-plugged-4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-57aaa1b4-3f06-451c-9ee8-1970f70c2da7 req-6db71c92-53ae-4370-85cd-d0d6e404f7dc service nova] Acquiring lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-57aaa1b4-3f06-451c-9ee8-1970f70c2da7 req-6db71c92-53ae-4370-85cd-d0d6e404f7dc service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-57aaa1b4-3f06-451c-9ee8-1970f70c2da7 req-6db71c92-53ae-4370-85cd-d0d6e404f7dc service nova] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-57aaa1b4-3f06-451c-9ee8-1970f70c2da7 req-6db71c92-53ae-4370-85cd-d0d6e404f7dc service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] No waiting events found dispatching network-vif-plugged-4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:16 user nova-compute[72000]: WARNING nova.compute.manager [req-57aaa1b4-3f06-451c-9ee8-1970f70c2da7 req-6db71c92-53ae-4370-85cd-d0d6e404f7dc service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received unexpected event network-vif-plugged-4054e387-560a-4992-b0e5-733ff789f2f1 for instance with vm_state active and task_state deleting.
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aeace1-8b58-478c-92c7-084712c47194]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[320a758d-ab2a-445c-9b1c-37a82dca77b6]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Flushing IO for device /dev/sdg {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec5dbcf-30ba-4c97-8f9e-cce460c1f989]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[20081c4f-e066-47c2-8494-1b2eba9ff97e]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] SCSI volumes sdg have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce38bcb-2b80-4adc-8f97-caf22cbf145d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85b3c31-7485-48be-bfc6-3e4855a5b1d3]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83, portal: 172.16.0.220,3260]
Aug 16 18:07:16 user nova-compute[72000]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83, portal: 172.16.0.220,3260] successful.
Aug 16 18:07:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eff1de9-c635-4d52-b81b-4ee9ab1b4e83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cb74ba-38cf-4815-bc85-2512496699c5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] <== disconnect_volume: return (1650ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:07:16 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Deleting instance files /opt/stack/data/nova/instances/b22234a2-c9cb-4a04-856c-ef718c80e59d_del
Aug 16 18:07:16 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Deletion of /opt/stack/data/nova/instances/b22234a2-c9cb-4a04-856c-ef718c80e59d_del complete
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.277s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:16 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:16 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[13010fe3-e71a-48d9-8b63-29746089697e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:07:16 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1729fce9-8c10-44e2-9eda-0b54c1b77dac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e] added
Aug 16 18:07:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:16 user nova-compute[72000]: INFO nova.compute.manager [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Took 4.96 seconds to destroy the instance on the hypervisor.
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5656cb4-17d1-4b2c-807a-ea963fc47374]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[587404bc-874d-4c8b-b25b-fafcecfefca9]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SiVZcTWK {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SiVZcTWK" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b8530b-cdd2-4c1d-a41c-64e525edeeae]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SiVZcTWK'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[019f7d77-f805-4d52-a93f-9df53d20e99d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d9191a-0f2b-4149-b8d7-f6ad2088d184]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:17 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:17 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:17 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:17 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --login" returned: 0 in 0.212s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[15491bdd-fbaf-4eab-90ad-992e0d0daa7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e, portal: 172.16.0.220,3260]
Aug 16 18:07:17 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e, portal: 172.16.0.220,3260] successful.
Aug 16 18:07:17 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29be6de-dcde-4076-a85e-82147200f5c5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0fdcab-14f4-420d-83b1-4272ce2e647e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:17 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:17 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:07:17 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:17 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:17 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:07:17 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc21a1b8-22a1-4aa8-9458-9b5b189e500e]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:07:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiVZcTWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] <== connect_volume: return (1773ms) {'type': 'block', 'scsi_wwn': '23138386633663865', 'path': '/dev/sdd'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138386633663865', 'path': '/dev/sdd'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcgtjbPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:07:18 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:18 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:18 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe0263f-3667-4b65-8cfe-2f9ac79cd1db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:07:18 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[31124eaf-457e-47a0-94a8-328209692c83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36] added
Aug 16 18:07:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[200e2025-4e1d-424b-95e6-53a904545bbd]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce366fb7-abee-4da5-b2a3-63790361391d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcgtjbPV {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JcgtjbPV" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[109fc63b-eed5-4702-94dc-f959de02ed74]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JcgtjbPV'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f320493-2fdc-4dcd-9fe5-115aa0b8c1f6]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d17bf18-a008-443b-81d8-9da00e4b0af0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:18 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:18 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:07:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:18 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:18 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:07:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[382cacd6-20a4-452d-a664-f3d9a8d3188e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36, portal: 172.16.0.220,3260]
Aug 16 18:07:18 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36, portal: 172.16.0.220,3260] successful.
Aug 16 18:07:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8045762c-c88b-4556-8a07-06ca661377eb]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e060d0e-9072-4ee0-80d3-5a5cef33881a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:18 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:18 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:07:18 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:07:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:18 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:18 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:07:18 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:07:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d96775-902d-4682-bbb8-bae7c5053e04]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:07:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcgtjbPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-5b746345-ec55-47ab-98ec-86d6d3ce2d09 req-6c8a513e-bed4-44ff-adb6-7929d4dcda87 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-deleted-06896619-5181-4031-8206-fa030b712f6f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:19 user nova-compute[72000]: INFO nova.compute.manager [req-5b746345-ec55-47ab-98ec-86d6d3ce2d09 req-6c8a513e-bed4-44ff-adb6-7929d4dcda87 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Neutron deleted interface 06896619-5181-4031-8206-fa030b712f6f; detaching it from the instance and deleting it from the info cache
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.neutron [req-5b746345-ec55-47ab-98ec-86d6d3ce2d09 req-6c8a513e-bed4-44ff-adb6-7929d4dcda87 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [{"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "address": "fa:16:3e:f1:19:3a", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e457e9-46", "ovs_interfaceid": "92e457e9-4656-4c5f-b1a4-dba3b27f7ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-5b746345-ec55-47ab-98ec-86d6d3ce2d09 req-6c8a513e-bed4-44ff-adb6-7929d4dcda87 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Detach interface failed, port_id=06896619-5181-4031-8206-fa030b712f6f, reason: Instance b22234a2-c9cb-4a04-856c-ef718c80e59d could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26636393965653661', 'path': '/dev/sde'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636393965653661', 'path': '/dev/sde'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:30:32,bridge_name='br-int',has_traffic_filtering=True,id=cf295ae9-9926-431c-8b42-7be3820eee21,network=Network(cdd13d99-07bb-4651-8501-0b655d123a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf295ae9-99') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:7c:06,bridge_name='br-int',has_traffic_filtering=True,id=edd566b2-37d8-49b0-9c69-e35d9de5833e,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedd566b2-37') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:9c:95,bridge_name='br-int',has_traffic_filtering=True,id=c803184c-44f7-48cc-aead-7e7ef312d397,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc803184c-44') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:89:12,bridge_name='br-int',has_traffic_filtering=True,id=f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dbe6f9-25') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=20f0c252-2401-4fd8-9811-ce038433d723,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f0c252-24') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:61:36,bridge_name='br-int',has_traffic_filtering=True,id=5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3351e7-8f') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:02,bridge_name='br-int',has_traffic_filtering=True,id=8dae8097-fbe9-439d-a321-f7ef4e14b57a,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dae8097-fb') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.objects.instance [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lazy-loading 'pci_devices' on Instance uuid d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:07:19 user nova-compute[72000]:   <uuid>d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7</uuid>
Aug 16 18:07:19 user nova-compute[72000]:   <name>instance-00000013</name>
Aug 16 18:07:19 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:07:19 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:07:19 user nova-compute[72000]:   <metadata>
Aug 16 18:07:19 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:07:19 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:07:19 user nova-compute[72000]:       <nova:name>tempest-device-tagging-server-357790648</nova:name>
Aug 16 18:07:19 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:07:14</nova:creationTime>
Aug 16 18:07:19 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:07:19 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:07:19 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:07:19 user nova-compute[72000]:       <nova:owner>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:user uuid="8dd1f88737aa49e3b635f8e3dbf4d025">tempest-TaggedBootDevicesTest-1049065283-project-member</nova:user>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:project uuid="df15c3db43cb4d6b925b43632d88617a">tempest-TaggedBootDevicesTest-1049065283</nova:project>
Aug 16 18:07:19 user nova-compute[72000]:       </nova:owner>
Aug 16 18:07:19 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:07:19 user nova-compute[72000]:       <nova:ports>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:port uuid="cf295ae9-9926-431c-8b42-7be3820eee21">
Aug 16 18:07:19 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 18:07:19 user nova-compute[72000]:         </nova:port>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:port uuid="edd566b2-37d8-49b0-9c69-e35d9de5833e">
Aug 16 18:07:19 user nova-compute[72000]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Aug 16 18:07:19 user nova-compute[72000]:         </nova:port>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:port uuid="c803184c-44f7-48cc-aead-7e7ef312d397">
Aug 16 18:07:19 user nova-compute[72000]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
Aug 16 18:07:19 user nova-compute[72000]:         </nova:port>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:port uuid="f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6">
Aug 16 18:07:19 user nova-compute[72000]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Aug 16 18:07:19 user nova-compute[72000]:         </nova:port>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:port uuid="20f0c252-2401-4fd8-9811-ce038433d723">
Aug 16 18:07:19 user nova-compute[72000]:           <nova:ip type="fixed" address="10.1.1.180" ipVersion="4"/>
Aug 16 18:07:19 user nova-compute[72000]:         </nova:port>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:port uuid="5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7">
Aug 16 18:07:19 user nova-compute[72000]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 16 18:07:19 user nova-compute[72000]:         </nova:port>
Aug 16 18:07:19 user nova-compute[72000]:         <nova:port uuid="8dae8097-fbe9-439d-a321-f7ef4e14b57a">
Aug 16 18:07:19 user nova-compute[72000]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 16 18:07:19 user nova-compute[72000]:         </nova:port>
Aug 16 18:07:19 user nova-compute[72000]:       </nova:ports>
Aug 16 18:07:19 user nova-compute[72000]:     </nova:instance>
Aug 16 18:07:19 user nova-compute[72000]:   </metadata>
Aug 16 18:07:19 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:07:19 user nova-compute[72000]:     <system>
Aug 16 18:07:19 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:07:19 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:07:19 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:07:19 user nova-compute[72000]:       <entry name="serial">d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7</entry>
Aug 16 18:07:19 user nova-compute[72000]:       <entry name="uuid">d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7</entry>
Aug 16 18:07:19 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:07:19 user nova-compute[72000]:     </system>
Aug 16 18:07:19 user nova-compute[72000]:   </sysinfo>
Aug 16 18:07:19 user nova-compute[72000]:   <os>
Aug 16 18:07:19 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:07:19 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:07:19 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:07:19 user nova-compute[72000]:   </os>
Aug 16 18:07:19 user nova-compute[72000]:   <features>
Aug 16 18:07:19 user nova-compute[72000]:     <acpi/>
Aug 16 18:07:19 user nova-compute[72000]:     <apic/>
Aug 16 18:07:19 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:07:19 user nova-compute[72000]:   </features>
Aug 16 18:07:19 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:07:19 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:07:19 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:07:19 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:07:19 user nova-compute[72000]:   </clock>
Aug 16 18:07:19 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:07:19 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:07:19 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:07:19 user nova-compute[72000]:   </cpu>
Aug 16 18:07:19 user nova-compute[72000]:   <devices>
Aug 16 18:07:19 user nova-compute[72000]:     <disk type="file" device="cdrom">
Aug 16 18:07:19 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none"/>
Aug 16 18:07:19 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7/disk.config"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="hda" bus="ide"/>
Aug 16 18:07:19 user nova-compute[72000]:     </disk>
Aug 16 18:07:19 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:07:19 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:07:19 user nova-compute[72000]:       <source dev="/dev/sdc"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:       <serial>6c3cc35d-082a-456a-982b-5d9e3e5a4ac5</serial>
Aug 16 18:07:19 user nova-compute[72000]:     </disk>
Aug 16 18:07:19 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:07:19 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:07:19 user nova-compute[72000]:       <source dev="/dev/sdd"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:       <serial>b080a215-fa47-44d3-a3e1-3ca6995d820e</serial>
Aug 16 18:07:19 user nova-compute[72000]:     </disk>
Aug 16 18:07:19 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:07:19 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:07:19 user nova-compute[72000]:       <source dev="/dev/sde"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="vdc" bus="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:       <serial>785e7214-45bc-4d8e-b8fe-351099f6fa36</serial>
Aug 16 18:07:19 user nova-compute[72000]:     </disk>
Aug 16 18:07:19 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:07:19 user nova-compute[72000]:       <mac address="fa:16:3e:d8:30:32"/>
Aug 16 18:07:19 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="tapcf295ae9-99"/>
Aug 16 18:07:19 user nova-compute[72000]:     </interface>
Aug 16 18:07:19 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:07:19 user nova-compute[72000]:       <mac address="fa:16:3e:2f:7c:06"/>
Aug 16 18:07:19 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="tapedd566b2-37"/>
Aug 16 18:07:19 user nova-compute[72000]:     </interface>
Aug 16 18:07:19 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:07:19 user nova-compute[72000]:       <mac address="fa:16:3e:53:9c:95"/>
Aug 16 18:07:19 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="tapc803184c-44"/>
Aug 16 18:07:19 user nova-compute[72000]:     </interface>
Aug 16 18:07:19 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:07:19 user nova-compute[72000]:       <mac address="fa:16:3e:69:89:12"/>
Aug 16 18:07:19 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="tapf9dbe6f9-25"/>
Aug 16 18:07:19 user nova-compute[72000]:     </interface>
Aug 16 18:07:19 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:07:19 user nova-compute[72000]:       <mac address="fa:16:3e:3b:1e:fa"/>
Aug 16 18:07:19 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="tap20f0c252-24"/>
Aug 16 18:07:19 user nova-compute[72000]:     </interface>
Aug 16 18:07:19 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:07:19 user nova-compute[72000]:       <mac address="fa:16:3e:a8:61:36"/>
Aug 16 18:07:19 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="tap5e3351e7-8f"/>
Aug 16 18:07:19 user nova-compute[72000]:     </interface>
Aug 16 18:07:19 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:07:19 user nova-compute[72000]:       <mac address="fa:16:3e:81:a5:02"/>
Aug 16 18:07:19 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:07:19 user nova-compute[72000]:       <target dev="tap8dae8097-fb"/>
Aug 16 18:07:19 user nova-compute[72000]:     </interface>
Aug 16 18:07:19 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:07:19 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7/console.log" append="off"/>
Aug 16 18:07:19 user nova-compute[72000]:     </serial>
Aug 16 18:07:19 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:07:19 user nova-compute[72000]:     <video>
Aug 16 18:07:19 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:19 user nova-compute[72000]:     </video>
Aug 16 18:07:19 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:07:19 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:07:19 user nova-compute[72000]:     </rng>
Aug 16 18:07:19 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:07:19 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:07:19 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:07:19 user nova-compute[72000]:     </memballoon>
Aug 16 18:07:19 user nova-compute[72000]:   </devices>
Aug 16 18:07:19 user nova-compute[72000]: </domain>
Aug 16 18:07:19 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:30:32,bridge_name='br-int',has_traffic_filtering=True,id=cf295ae9-9926-431c-8b42-7be3820eee21,network=Network(cdd13d99-07bb-4651-8501-0b655d123a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf295ae9-99') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:30:32,bridge_name='br-int',has_traffic_filtering=True,id=cf295ae9-9926-431c-8b42-7be3820eee21,network=Network(cdd13d99-07bb-4651-8501-0b655d123a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf295ae9-99') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf295ae9-99, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf295ae9-99, col_values=(('external_ids', {'iface-id': 'cf295ae9-9926-431c-8b42-7be3820eee21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:30:32', 'vm-uuid': 'd6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: INFO os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:30:32,bridge_name='br-int',has_traffic_filtering=True,id=cf295ae9-9926-431c-8b42-7be3820eee21,network=Network(cdd13d99-07bb-4651-8501-0b655d123a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf295ae9-99')
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:7c:06,bridge_name='br-int',has_traffic_filtering=True,id=edd566b2-37d8-49b0-9c69-e35d9de5833e,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedd566b2-37') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:7c:06,bridge_name='br-int',has_traffic_filtering=True,id=edd566b2-37d8-49b0-9c69-e35d9de5833e,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedd566b2-37') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedd566b2-37, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapedd566b2-37, col_values=(('external_ids', {'iface-id': 'edd566b2-37d8-49b0-9c69-e35d9de5833e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:7c:06', 'vm-uuid': 'd6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: INFO os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:7c:06,bridge_name='br-int',has_traffic_filtering=True,id=edd566b2-37d8-49b0-9c69-e35d9de5833e,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedd566b2-37')
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:9c:95,bridge_name='br-int',has_traffic_filtering=True,id=c803184c-44f7-48cc-aead-7e7ef312d397,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc803184c-44') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:9c:95,bridge_name='br-int',has_traffic_filtering=True,id=c803184c-44f7-48cc-aead-7e7ef312d397,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc803184c-44') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc803184c-44, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc803184c-44, col_values=(('external_ids', {'iface-id': 'c803184c-44f7-48cc-aead-7e7ef312d397', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:9c:95', 'vm-uuid': 'd6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: INFO os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:9c:95,bridge_name='br-int',has_traffic_filtering=True,id=c803184c-44f7-48cc-aead-7e7ef312d397,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc803184c-44')
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:89:12,bridge_name='br-int',has_traffic_filtering=True,id=f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dbe6f9-25') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:89:12,bridge_name='br-int',has_traffic_filtering=True,id=f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dbe6f9-25') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9dbe6f9-25, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9dbe6f9-25, col_values=(('external_ids', {'iface-id': 'f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:89:12', 'vm-uuid': 'd6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: INFO os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:89:12,bridge_name='br-int',has_traffic_filtering=True,id=f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dbe6f9-25')
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=20f0c252-2401-4fd8-9811-ce038433d723,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f0c252-24') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=20f0c252-2401-4fd8-9811-ce038433d723,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f0c252-24') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20f0c252-24, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20f0c252-24, col_values=(('external_ids', {'iface-id': '20f0c252-2401-4fd8-9811-ce038433d723', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:1e:fa', 'vm-uuid': 'd6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: INFO os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=20f0c252-2401-4fd8-9811-ce038433d723,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f0c252-24')
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:61:36,bridge_name='br-int',has_traffic_filtering=True,id=5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3351e7-8f') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:61:36,bridge_name='br-int',has_traffic_filtering=True,id=5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3351e7-8f') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e3351e7-8f, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e3351e7-8f, col_values=(('external_ids', {'iface-id': '5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:61:36', 'vm-uuid': 'd6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: INFO os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:61:36,bridge_name='br-int',has_traffic_filtering=True,id=5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3351e7-8f')
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:02,bridge_name='br-int',has_traffic_filtering=True,id=8dae8097-fbe9-439d-a321-f7ef4e14b57a,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dae8097-fb') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:02,bridge_name='br-int',has_traffic_filtering=True,id=8dae8097-fbe9-439d-a321-f7ef4e14b57a,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dae8097-fb') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8dae8097-fb, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8dae8097-fb, col_values=(('external_ids', {'iface-id': '8dae8097-fbe9-439d-a321-f7ef4e14b57a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:a5:02', 'vm-uuid': 'd6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:20 user nova-compute[72000]: INFO os_vif [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:02,bridge_name='br-int',has_traffic_filtering=True,id=8dae8097-fbe9-439d-a321-f7ef4e14b57a,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dae8097-fb')
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] No BDM found with device name hda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] No VIF found with MAC fa:16:3e:d8:30:32, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] No VIF found with MAC fa:16:3e:3b:1e:fa, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:07:20 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Using config drive
Aug 16 18:07:20 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Creating config drive at /opt/stack/data/nova/instances/d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7/disk.config
Aug 16 18:07:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm5st86lm {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm5st86lm" returned: 0 in 0.052s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-deleted-92e457e9-4656-4c5f-b1a4-dba3b27f7ac8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:21 user nova-compute[72000]: INFO nova.compute.manager [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Neutron deleted interface 92e457e9-4656-4c5f-b1a4-dba3b27f7ac8; detaching it from the instance and deleting it from the info cache
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.network.neutron [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [{"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "address": "fa:16:3e:f6:f2:67", "network": {"id": "ebdde453-eb51-4eb0-a681-e366e28af0e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-174201359", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74222f6d-fc", "ovs_interfaceid": "74222f6d-fc28-4ae3-a554-d60f2dce0c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Detach interface failed, port_id=92e457e9-4656-4c5f-b1a4-dba3b27f7ac8, reason: Instance b22234a2-c9cb-4a04-856c-ef718c80e59d could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-deleted-74222f6d-fc28-4ae3-a554-d60f2dce0c57 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:21 user nova-compute[72000]: INFO nova.compute.manager [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Neutron deleted interface 74222f6d-fc28-4ae3-a554-d60f2dce0c57; detaching it from the instance and deleting it from the info cache
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.network.neutron [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [{"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4054e387-560a-4992-b0e5-733ff789f2f1", "address": "fa:16:3e:bf:17:72", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4054e387-56", "ovs_interfaceid": "4054e387-560a-4992-b0e5-733ff789f2f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Detach interface failed, port_id=74222f6d-fc28-4ae3-a554-d60f2dce0c57, reason: Instance b22234a2-c9cb-4a04-856c-ef718c80e59d could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-deleted-4054e387-560a-4992-b0e5-733ff789f2f1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:21 user nova-compute[72000]: INFO nova.compute.manager [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Neutron deleted interface 4054e387-560a-4992-b0e5-733ff789f2f1; detaching it from the instance and deleting it from the info cache
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.network.neutron [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [{"id": "de767d0a-0b30-40a6-9215-7e4f76277f78", "address": "fa:16:3e:2b:ea:a1", "network": {"id": "9b257c2f-c837-4feb-a93c-d098b6fb8ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-794369444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde767d0a-0b", "ovs_interfaceid": "de767d0a-0b30-40a6-9215-7e4f76277f78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:21 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Took 4.70 seconds to deallocate network for instance.
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-51a85de7-7f6b-4bc7-b097-af48d0e3a185 req-dacae2af-af8b-468a-9cba-f86b6a90d6b5 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Detach interface failed, port_id=4054e387-560a-4992-b0e5-733ff789f2f1, reason: Instance b22234a2-c9cb-4a04-856c-ef718c80e59d could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "f5fc020a-3be1-4e78-8825-89f06406e945" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:21 user nova-compute[72000]: INFO nova.compute.manager [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Unshelving
Aug 16 18:07:21 user nova-compute[72000]: INFO nova.virt.block_device [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Booting with volume 66a71622-9305-481d-b3f1-ae05f26abde8 at /dev/vda
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209226.844945, b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:07:21 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] VM Stopped (Lifecycle Event)
Aug 16 18:07:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-41a2b3f0-52d6-45ba-9684-61d333865dd5 None None] [instance: b1e08e6a-fa0d-4c82-9dc6-dc07acd5c212] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG os_brick.utils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[395377c8-db26-45cd-bfe8-57a79a96b8f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2a209f-01cb-46c1-8a5a-614bc3f0b894]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfb1285-7bed-498e-85bd-b2cc549dcb3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d58170e-34cd-4756-adae-6c33e9afcc7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:07:22 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:07:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6382ce7f-4233-4dcc-bb7f-f091e2af1309]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG os_brick.utils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating existing volume attachment record: 34b8d466-eb8b-45b2-9a0a-e8c07b6db3d7 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-b1543ab5-9ddd-43a8-832c-888c2b12ee4c req-3d9d41ac-786b-4644-87de-0d57dc55de4f service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b1543ab5-9ddd-43a8-832c-888c2b12ee4c req-3d9d41ac-786b-4644-87de-0d57dc55de4f service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b1543ab5-9ddd-43a8-832c-888c2b12ee4c req-3d9d41ac-786b-4644-87de-0d57dc55de4f service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b1543ab5-9ddd-43a8-832c-888c2b12ee4c req-3d9d41ac-786b-4644-87de-0d57dc55de4f service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-b1543ab5-9ddd-43a8-832c-888c2b12ee4c req-3d9d41ac-786b-4644-87de-0d57dc55de4f service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:22 user nova-compute[72000]: WARNING nova.compute.manager [req-b1543ab5-9ddd-43a8-832c-888c2b12ee4c req-3d9d41ac-786b-4644-87de-0d57dc55de4f service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-cf295ae9-9926-431c-8b42-7be3820eee21 for instance with vm_state building and task_state spawning.
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-37d9938d-6e26-4523-9880-d78a336b0f58 req-ae3303d5-8772-4b9b-8197-2b38586fc29b service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-37d9938d-6e26-4523-9880-d78a336b0f58 req-ae3303d5-8772-4b9b-8197-2b38586fc29b service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-37d9938d-6e26-4523-9880-d78a336b0f58 req-ae3303d5-8772-4b9b-8197-2b38586fc29b service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-37d9938d-6e26-4523-9880-d78a336b0f58 req-ae3303d5-8772-4b9b-8197-2b38586fc29b service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-37d9938d-6e26-4523-9880-d78a336b0f58 req-ae3303d5-8772-4b9b-8197-2b38586fc29b service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:22 user nova-compute[72000]: WARNING nova.compute.manager [req-37d9938d-6e26-4523-9880-d78a336b0f58 req-ae3303d5-8772-4b9b-8197-2b38586fc29b service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-edd566b2-37d8-49b0-9c69-e35d9de5833e for instance with vm_state building and task_state spawning.
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:23 user nova-compute[72000]: DEBUG nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Received event network-vif-deleted-de767d0a-0b30-40a6-9215-7e4f76277f78 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:23 user nova-compute[72000]: INFO nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Neutron deleted interface de767d0a-0b30-40a6-9215-7e4f76277f78; detaching it from the instance and deleting it from the info cache
Aug 16 18:07:23 user nova-compute[72000]: DEBUG nova.network.neutron [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Updating instance_info_cache with network_info: [{"id": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "address": "fa:16:3e:7e:b0:77", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.114", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aa08bd-51", "ovs_interfaceid": "51aa08bd-5170-4234-8c91-07df0fa81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "address": "fa:16:3e:4c:67:a2", "network": {"id": "52d18b62-3827-4ad8-88b3-c11be5e0a1b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-2116102787", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.80", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "de0840edb5e14cfd82ab75d5c09b8d21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8000ae-52", "ovs_interfaceid": "7e8000ae-52d9-4a24-ad5c-f6a80cca8210", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Detach interface failed, port_id=de767d0a-0b30-40a6-9215-7e4f76277f78, reason: Instance b22234a2-c9cb-4a04-856c-ef718c80e59d could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:24 user nova-compute[72000]: WARNING nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-c803184c-44f7-48cc-aead-7e7ef312d397 for instance with vm_state building and task_state spawning.
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:24 user nova-compute[72000]: WARNING nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-c803184c-44f7-48cc-aead-7e7ef312d397 for instance with vm_state building and task_state spawning.
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:24 user nova-compute[72000]: WARNING nova.compute.manager [req-02986296-b3df-43d2-a4ed-9ecc02f7ecc2 req-50565406-f46d-4e89-bb99-ac5c7ae24c13 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 for instance with vm_state building and task_state spawning.
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-4d2e3613-9b31-49a0-b997-2e22206bbc32 req-31c492e3-2db2-4b01-ad15-d6b3d0ab2d4a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4d2e3613-9b31-49a0-b997-2e22206bbc32 req-31c492e3-2db2-4b01-ad15-d6b3d0ab2d4a service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4d2e3613-9b31-49a0-b997-2e22206bbc32 req-31c492e3-2db2-4b01-ad15-d6b3d0ab2d4a service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4d2e3613-9b31-49a0-b997-2e22206bbc32 req-31c492e3-2db2-4b01-ad15-d6b3d0ab2d4a service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-4d2e3613-9b31-49a0-b997-2e22206bbc32 req-31c492e3-2db2-4b01-ad15-d6b3d0ab2d4a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:24 user nova-compute[72000]: WARNING nova.compute.manager [req-4d2e3613-9b31-49a0-b997-2e22206bbc32 req-31c492e3-2db2-4b01-ad15-d6b3d0ab2d4a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-cf295ae9-9926-431c-8b42-7be3820eee21 for instance with vm_state building and task_state spawning.
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: INFO nova.compute.manager [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Took 2.81 seconds to detach 3 volumes for instance.
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:24 user nova-compute[72000]: WARNING nova.compute.manager [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-edd566b2-37d8-49b0-9c69-e35d9de5833e for instance with vm_state building and task_state spawning.
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:24 user nova-compute[72000]: WARNING nova.compute.manager [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-20f0c252-2401-4fd8-9811-ce038433d723 for instance with vm_state building and task_state spawning.
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:24 user nova-compute[72000]: WARNING nova.compute.manager [req-a8fe92b0-09fb-4ba8-922a-011abf96fce7 req-60bc756d-c990-443c-9e8a-a5dc4ff441df service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-20f0c252-2401-4fd8-9811-ce038433d723 for instance with vm_state building and task_state spawning.
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:24 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:25 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Deleted allocations for instance b22234a2-c9cb-4a04-856c-ef718c80e59d
Aug 16 18:07:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ffe535d-19a4-4632-950d-82ec312d1489 tempest-TaggedBootDevicesTest_v242-1668389145 tempest-TaggedBootDevicesTest_v242-1668389145-project-member] Lock "b22234a2-c9cb-4a04-856c-ef718c80e59d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.235s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:25 user nova-compute[72000]: WARNING nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 for instance with vm_state building and task_state spawning.
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:25 user nova-compute[72000]: WARNING nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 for instance with vm_state building and task_state spawning.
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:25 user nova-compute[72000]: WARNING nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 for instance with vm_state building and task_state spawning.
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:25 user nova-compute[72000]: WARNING nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a for instance with vm_state building and task_state spawning.
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:25 user nova-compute[72000]: WARNING nova.compute.manager [req-b553ea14-dcdc-4b16-9b27-31484d9c1725 req-61060c85-9b2a-4bed-bf2a-552c5e0d3705 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a for instance with vm_state building and task_state spawning.
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209246.3453007, d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:07:26 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] VM Resumed (Lifecycle Event)
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:07:26 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Instance spawned successfully.
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:07:26 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209246.3546448, d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:07:26 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] VM Started (Lifecycle Event)
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:07:26 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:07:26 user nova-compute[72000]: INFO nova.compute.manager [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Took 11.76 seconds to spawn the instance on the hypervisor.
Aug 16 18:07:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:26 user nova-compute[72000]: INFO nova.compute.manager [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Took 60.86 seconds to build instance.
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe75f89d-5dff-4c33-8d9b-1e802422a67a tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 60.978s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 51.016s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:26 user nova-compute[72000]: INFO nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:28 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:07:28 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7390MB free_disk=23.94912338256836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a8532341-62b3-4c58-b3d8-db5440ad08c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance d76a0b56-0337-45a0-96db-83c267d5d649 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f5fc020a-3be1-4e78-8825-89f06406e945 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209233.9425497, b22234a2-c9cb-4a04-856c-ef718c80e59d => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:07:28 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] VM Stopped (Lifecycle Event)
Aug 16 18:07:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-39b9235c-2cc5-4ccd-86a1-6d8393f43198 None None] [instance: b22234a2-c9cb-4a04-856c-ef718c80e59d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:07:29 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:07:29 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:07:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:07:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:33 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lazy-loading 'pci_requests' on Instance uuid f5fc020a-3be1-4e78-8825-89f06406e945 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:07:33 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lazy-loading 'numa_topology' on Instance uuid f5fc020a-3be1-4e78-8825-89f06406e945 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:07:33 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:07:33 user nova-compute[72000]: INFO nova.compute.claims [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Claim successful on node user
Aug 16 18:07:33 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:07:33 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:07:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:34 user nova-compute[72000]: INFO nova.network.neutron [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating port ff6674fb-0507-4b0e-a63e-b541fa45d07e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 18:07:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:07:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquired lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:07:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:07:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-044c8e20-6c67-4c5c-8c1c-837040e11166 req-51bb82a9-bb51-4084-8ab1-08b8eda6f454 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-changed-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-044c8e20-6c67-4c5c-8c1c-837040e11166 req-51bb82a9-bb51-4084-8ab1-08b8eda6f454 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Refreshing instance network info cache due to event network-changed-ff6674fb-0507-4b0e-a63e-b541fa45d07e. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:07:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-044c8e20-6c67-4c5c-8c1c-837040e11166 req-51bb82a9-bb51-4084-8ab1-08b8eda6f454 service nova] Acquiring lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating instance_info_cache with network_info: [{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Releasing lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:07:35 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Creating image(s)
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Ensure instance console log exists: /opt/stack/data/nova/instances/f5fc020a-3be1-4e78-8825-89f06406e945/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Start _get_guest_xml network_info=[{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkFJdhxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5fc020a-3be1-4e78-8825-89f06406e945', 'attached_at': '', 'detached_at': '', 'volume_id': '66a71622-9305-481d-b3f1-ae05f26abde8', 'serial': '66a71622-9305-481d-b3f1-ae05f26abde8'}, 'attachment_id': '34b8d466-eb8b-45b2-9a0a-e8c07b6db3d7', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-044c8e20-6c67-4c5c-8c1c-837040e11166 req-51bb82a9-bb51-4084-8ab1-08b8eda6f454 service nova] Acquired lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-044c8e20-6c67-4c5c-8c1c-837040e11166 req-51bb82a9-bb51-4084-8ab1-08b8eda6f454 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Refreshing network info cache for port ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:07:35 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:07:35 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5fc020a-3be1-4e78-8825-89f06406e945 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkFJdhxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:07:35 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:35 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:07:35 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c336e4b3-31ac-47fb-b48d-fe0499e7339b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:07:35 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[81db7c62-5ba2-440a-a955-8864ac29faed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8] added
Aug 16 18:07:35 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2e4ace-3443-43d1-89a1-f4d7dc6b0db9]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf703d9-d26c-4406-8621-da67cb51e5c5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HkFJdhxG {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HkFJdhxG" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c21896-158b-4f97-97a0-7c40e3c5121e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HkFJdhxG'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4ada87-beae-40ab-a898-bd1836b63a39]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[508e677d-2897-4188-ac0f-19359997a901]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:07:35 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:07:35 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c939acda-17d6-4e7d-9191-68a2ab604dcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260]
Aug 16 18:07:35 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260] successful.
Aug 16 18:07:35 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55bac03-05de-4405-af37-713753a162b0]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[25601ad6-c7a3-424f-acc8-d7d4914bd4aa]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:07:35 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:07:35 user nova-compute[72000]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:07:35 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6200592-e61f-4194-ad1b-19ac8913a9f7]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-044c8e20-6c67-4c5c-8c1c-837040e11166 req-51bb82a9-bb51-4084-8ab1-08b8eda6f454 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updated VIF entry in instance network info cache for port ff6674fb-0507-4b0e-a63e-b541fa45d07e. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:07:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-044c8e20-6c67-4c5c-8c1c-837040e11166 req-51bb82a9-bb51-4084-8ab1-08b8eda6f454 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating instance_info_cache with network_info: [{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-044c8e20-6c67-4c5c-8c1c-837040e11166 req-51bb82a9-bb51-4084-8ab1-08b8eda6f454 service nova] Releasing lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkFJdhxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23364326233623538', 'path': '/dev/sdf'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364326233623538', 'path': '/dev/sdf'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671854720',display_name='tempest-TestShelveInstance-server-1671854720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671854720',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-381507571',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9e70b32f569148f598a9ea19771d9d64',ramdisk_id='',reservation_id='r-4l1srynu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-1203105608',owner_user_name='tempest-TestShelveInstance-1203105608-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:22Z,user_data=None,user_id='7bafbe976da14bcca011f17b17ca65ff',uuid=f5fc020a-3be1-4e78-8825-89f06406e945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converting VIF {"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lazy-loading 'pci_devices' on Instance uuid f5fc020a-3be1-4e78-8825-89f06406e945 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:07:36 user nova-compute[72000]:   <uuid>f5fc020a-3be1-4e78-8825-89f06406e945</uuid>
Aug 16 18:07:36 user nova-compute[72000]:   <name>instance-0000000d</name>
Aug 16 18:07:36 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:07:36 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:07:36 user nova-compute[72000]:   <metadata>
Aug 16 18:07:36 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:07:36 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:07:36 user nova-compute[72000]:       <nova:name>tempest-TestShelveInstance-server-1671854720</nova:name>
Aug 16 18:07:36 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:07:35</nova:creationTime>
Aug 16 18:07:36 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:07:36 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:07:36 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:07:36 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:07:36 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:07:36 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:07:36 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:07:36 user nova-compute[72000]:       <nova:owner>
Aug 16 18:07:36 user nova-compute[72000]:         <nova:user uuid="7bafbe976da14bcca011f17b17ca65ff">tempest-TestShelveInstance-1203105608-project-member</nova:user>
Aug 16 18:07:36 user nova-compute[72000]:         <nova:project uuid="9e70b32f569148f598a9ea19771d9d64">tempest-TestShelveInstance-1203105608</nova:project>
Aug 16 18:07:36 user nova-compute[72000]:       </nova:owner>
Aug 16 18:07:36 user nova-compute[72000]:       <nova:ports>
Aug 16 18:07:36 user nova-compute[72000]:         <nova:port uuid="ff6674fb-0507-4b0e-a63e-b541fa45d07e">
Aug 16 18:07:36 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 18:07:36 user nova-compute[72000]:         </nova:port>
Aug 16 18:07:36 user nova-compute[72000]:       </nova:ports>
Aug 16 18:07:36 user nova-compute[72000]:     </nova:instance>
Aug 16 18:07:36 user nova-compute[72000]:   </metadata>
Aug 16 18:07:36 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:07:36 user nova-compute[72000]:     <system>
Aug 16 18:07:36 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:07:36 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:07:36 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:07:36 user nova-compute[72000]:       <entry name="serial">f5fc020a-3be1-4e78-8825-89f06406e945</entry>
Aug 16 18:07:36 user nova-compute[72000]:       <entry name="uuid">f5fc020a-3be1-4e78-8825-89f06406e945</entry>
Aug 16 18:07:36 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:07:36 user nova-compute[72000]:     </system>
Aug 16 18:07:36 user nova-compute[72000]:   </sysinfo>
Aug 16 18:07:36 user nova-compute[72000]:   <os>
Aug 16 18:07:36 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:07:36 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:07:36 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:07:36 user nova-compute[72000]:   </os>
Aug 16 18:07:36 user nova-compute[72000]:   <features>
Aug 16 18:07:36 user nova-compute[72000]:     <acpi/>
Aug 16 18:07:36 user nova-compute[72000]:     <apic/>
Aug 16 18:07:36 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:07:36 user nova-compute[72000]:   </features>
Aug 16 18:07:36 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:07:36 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:07:36 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:07:36 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:07:36 user nova-compute[72000]:   </clock>
Aug 16 18:07:36 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:07:36 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:07:36 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:07:36 user nova-compute[72000]:   </cpu>
Aug 16 18:07:36 user nova-compute[72000]:   <devices>
Aug 16 18:07:36 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:07:36 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:07:36 user nova-compute[72000]:       <source dev="/dev/sdf"/>
Aug 16 18:07:36 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:07:36 user nova-compute[72000]:       <serial>66a71622-9305-481d-b3f1-ae05f26abde8</serial>
Aug 16 18:07:36 user nova-compute[72000]:     </disk>
Aug 16 18:07:36 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:07:36 user nova-compute[72000]:       <mac address="fa:16:3e:92:c9:51"/>
Aug 16 18:07:36 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:36 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:07:36 user nova-compute[72000]:       <target dev="tapff6674fb-05"/>
Aug 16 18:07:36 user nova-compute[72000]:     </interface>
Aug 16 18:07:36 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:07:36 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/f5fc020a-3be1-4e78-8825-89f06406e945/console.log" append="off"/>
Aug 16 18:07:36 user nova-compute[72000]:     </serial>
Aug 16 18:07:36 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:07:36 user nova-compute[72000]:     <video>
Aug 16 18:07:36 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:07:36 user nova-compute[72000]:     </video>
Aug 16 18:07:36 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:07:36 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:07:36 user nova-compute[72000]:     </rng>
Aug 16 18:07:36 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:07:36 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:07:36 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:07:36 user nova-compute[72000]:     </memballoon>
Aug 16 18:07:36 user nova-compute[72000]:   </devices>
Aug 16 18:07:36 user nova-compute[72000]: </domain>
Aug 16 18:07:36 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671854720',display_name='tempest-TestShelveInstance-server-1671854720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671854720',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-381507571',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:03:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9e70b32f569148f598a9ea19771d9d64',ramdisk_id='',reservation_id='r-4l1srynu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-1203105608',owner_user_name='tempest-TestShelveInstance-1203105608-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:22Z,user_data=None,user_id='7bafbe976da14bcca011f17b17ca65ff',uuid=f5fc020a-3be1-4e78-8825-89f06406e945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converting VIF {"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG os_vif [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:07:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff6674fb-05, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff6674fb-05, col_values=(('external_ids', {'iface-id': 'ff6674fb-0507-4b0e-a63e-b541fa45d07e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:c9:51', 'vm-uuid': 'f5fc020a-3be1-4e78-8825-89f06406e945'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:07:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:07:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:37 user nova-compute[72000]: INFO os_vif [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05')
Aug 16 18:07:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:07:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] No VIF found with MAC fa:16:3e:92:c9:51, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-d7e97cae-87b4-432b-9910-e29677877c90 req-66f8951a-99e6-4d7a-b7fb-59669971c439 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d7e97cae-87b4-432b-9910-e29677877c90 req-66f8951a-99e6-4d7a-b7fb-59669971c439 service nova] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d7e97cae-87b4-432b-9910-e29677877c90 req-66f8951a-99e6-4d7a-b7fb-59669971c439 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d7e97cae-87b4-432b-9910-e29677877c90 req-66f8951a-99e6-4d7a-b7fb-59669971c439 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-d7e97cae-87b4-432b-9910-e29677877c90 req-66f8951a-99e6-4d7a-b7fb-59669971c439 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] No waiting events found dispatching network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:38 user nova-compute[72000]: WARNING nova.compute.manager [req-d7e97cae-87b4-432b-9910-e29677877c90 req-66f8951a-99e6-4d7a-b7fb-59669971c439 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received unexpected event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 18:07:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209260.5152771, f5fc020a-3be1-4e78-8825-89f06406e945 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:07:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] VM Resumed (Lifecycle Event)
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:07:40 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Instance spawned successfully.
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:07:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209260.5191963, f5fc020a-3be1-4e78-8825-89f06406e945 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:07:40 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] VM Started (Lifecycle Event)
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a647ad6d-8f02-4084-b172-8b93eac68707 tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "f5fc020a-3be1-4e78-8825-89f06406e945" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.938s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-bb872851-b064-48c1-94bb-a6195aa17524 req-c68b16f9-16ae-4b81-9cad-4ef2c40ab992 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bb872851-b064-48c1-94bb-a6195aa17524 req-c68b16f9-16ae-4b81-9cad-4ef2c40ab992 service nova] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bb872851-b064-48c1-94bb-a6195aa17524 req-c68b16f9-16ae-4b81-9cad-4ef2c40ab992 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bb872851-b064-48c1-94bb-a6195aa17524 req-c68b16f9-16ae-4b81-9cad-4ef2c40ab992 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:07:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-bb872851-b064-48c1-94bb-a6195aa17524 req-c68b16f9-16ae-4b81-9cad-4ef2c40ab992 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] No waiting events found dispatching network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:07:40 user nova-compute[72000]: WARNING nova.compute.manager [req-bb872851-b064-48c1-94bb-a6195aa17524 req-c68b16f9-16ae-4b81-9cad-4ef2c40ab992 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received unexpected event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e for instance with vm_state active and task_state None.
Aug 16 18:07:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:07:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Acquiring lock "d76a0b56-0337-45a0-96db-83c267d5d649" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "d76a0b56-0337-45a0-96db-83c267d5d649" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Acquiring lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:02 user nova-compute[72000]: INFO nova.compute.manager [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Terminating instance
Aug 16 18:08:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:08:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-d7f1cd56-4c6a-42e4-b170-d28bedcffe74 req-19b84b03-f45b-4817-b3b0-23eefa78f435 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Received event network-vif-unplugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d7f1cd56-4c6a-42e4-b170-d28bedcffe74 req-19b84b03-f45b-4817-b3b0-23eefa78f435 service nova] Acquiring lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d7f1cd56-4c6a-42e4-b170-d28bedcffe74 req-19b84b03-f45b-4817-b3b0-23eefa78f435 service nova] Lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d7f1cd56-4c6a-42e4-b170-d28bedcffe74 req-19b84b03-f45b-4817-b3b0-23eefa78f435 service nova] Lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-d7f1cd56-4c6a-42e4-b170-d28bedcffe74 req-19b84b03-f45b-4817-b3b0-23eefa78f435 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] No waiting events found dispatching network-vif-unplugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-d7f1cd56-4c6a-42e4-b170-d28bedcffe74 req-19b84b03-f45b-4817-b3b0-23eefa78f435 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Received event network-vif-unplugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Instance destroyed successfully.
Aug 16 18:08:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lazy-loading 'resources' on Instance uuid d76a0b56-0337-45a0-96db-83c267d5d649 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:06:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1761531755',display_name='tempest-VolumesActionsTest-instance-1761531755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1761531755',id=18,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='861bb8b3ad41464da8b5299c21bbf322',ramdisk_id='',reservation_id='r-wblzhhgq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1565940609',owner_user_name='tempest-VolumesActionsTest-1565940609-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:06:09Z,user_data=None,user_id='94ccb2de1e2a453e850090025d9197a3',uuid=d76a0b56-0337-45a0-96db-83c267d5d649,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "address": "fa:16:3e:5f:1b:31", "network": {"id": "bc32474a-9a54-423d-afbc-3f36e485673c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1763676722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861bb8b3ad41464da8b5299c21bbf322", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6135e2-5e", "ovs_interfaceid": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Converting VIF {"id": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "address": "fa:16:3e:5f:1b:31", "network": {"id": "bc32474a-9a54-423d-afbc-3f36e485673c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1763676722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861bb8b3ad41464da8b5299c21bbf322", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b6135e2-5e", "ovs_interfaceid": "4b6135e2-5eef-484e-a2b7-f39c78e1b225", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=4b6135e2-5eef-484e-a2b7-f39c78e1b225,network=Network(bc32474a-9a54-423d-afbc-3f36e485673c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6135e2-5e') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG os_vif [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=4b6135e2-5eef-484e-a2b7-f39c78e1b225,network=Network(bc32474a-9a54-423d-afbc-3f36e485673c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6135e2-5e') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b6135e2-5e, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:03 user nova-compute[72000]: INFO os_vif [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1b:31,bridge_name='br-int',has_traffic_filtering=True,id=4b6135e2-5eef-484e-a2b7-f39c78e1b225,network=Network(bc32474a-9a54-423d-afbc-3f36e485673c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b6135e2-5e')
Aug 16 18:08:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Deleting instance files /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649_del
Aug 16 18:08:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Deletion of /opt/stack/data/nova/instances/d76a0b56-0337-45a0-96db-83c267d5d649_del complete
Aug 16 18:08:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:03 user nova-compute[72000]: INFO nova.compute.manager [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 16 18:08:03 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:08:03 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:08:04 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:08:04 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Took 0.59 seconds to deallocate network for instance.
Aug 16 18:08:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-0765e14f-a097-46fd-9bd0-6b9300b2d8ed req-4ddc2d69-b81a-4bbf-925a-e44a505ad78a service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Received event network-vif-deleted-4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:08:04 user nova-compute[72000]: INFO nova.compute.manager [req-0765e14f-a097-46fd-9bd0-6b9300b2d8ed req-4ddc2d69-b81a-4bbf-925a-e44a505ad78a service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Neutron deleted interface 4b6135e2-5eef-484e-a2b7-f39c78e1b225; detaching it from the instance and deleting it from the info cache
Aug 16 18:08:04 user nova-compute[72000]: DEBUG nova.network.neutron [req-0765e14f-a097-46fd-9bd0-6b9300b2d8ed req-4ddc2d69-b81a-4bbf-925a-e44a505ad78a service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:08:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-0765e14f-a097-46fd-9bd0-6b9300b2d8ed req-4ddc2d69-b81a-4bbf-925a-e44a505ad78a service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Detach interface failed, port_id=4b6135e2-5eef-484e-a2b7-f39c78e1b225, reason: Instance d76a0b56-0337-45a0-96db-83c267d5d649 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:08:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:04 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:08:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:08:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:04 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Deleted allocations for instance d76a0b56-0337-45a0-96db-83c267d5d649
Aug 16 18:08:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4724a6ad-f00b-409b-af67-3f702e3e73d2 tempest-VolumesActionsTest-1565940609 tempest-VolumesActionsTest-1565940609-project-member] Lock "d76a0b56-0337-45a0-96db-83c267d5d649" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-e8e5484f-37ee-41d3-99a3-6fedb6537457 req-17e4f9fe-0612-4a1d-8d22-fb4434ea20f3 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Received event network-vif-plugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:08:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e8e5484f-37ee-41d3-99a3-6fedb6537457 req-17e4f9fe-0612-4a1d-8d22-fb4434ea20f3 service nova] Acquiring lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e8e5484f-37ee-41d3-99a3-6fedb6537457 req-17e4f9fe-0612-4a1d-8d22-fb4434ea20f3 service nova] Lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e8e5484f-37ee-41d3-99a3-6fedb6537457 req-17e4f9fe-0612-4a1d-8d22-fb4434ea20f3 service nova] Lock "d76a0b56-0337-45a0-96db-83c267d5d649-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-e8e5484f-37ee-41d3-99a3-6fedb6537457 req-17e4f9fe-0612-4a1d-8d22-fb4434ea20f3 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] No waiting events found dispatching network-vif-plugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:08:05 user nova-compute[72000]: WARNING nova.compute.manager [req-e8e5484f-37ee-41d3-99a3-6fedb6537457 req-17e4f9fe-0612-4a1d-8d22-fb4434ea20f3 service nova] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Received unexpected event network-vif-plugged-4b6135e2-5eef-484e-a2b7-f39c78e1b225 for instance with vm_state deleted and task_state None.
Aug 16 18:08:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:16 user nova-compute[72000]: DEBUG nova.objects.instance [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:08:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquired lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:08:16 user nova-compute[72000]: DEBUG nova.network.neutron [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:08:16 user nova-compute[72000]: DEBUG nova.objects.instance [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'info_cache' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.network.neutron [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updating instance_info_cache with network_info: [{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Releasing lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:08:17 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance destroyed successfully.
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.objects.instance [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'resources' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1089625936',display_name='tempest-AttachVolumeTestJSON-server-1089625936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1089625936',id=5,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErb04qZpbsRut/09YXjqZYrtOHdBhP2tPvZwbKrovgBjHoU1dEbeqloQimLOszuW/qVazGtyEHJi8FlrHeWujg55/6v8atkLH5KmnvoByesgAKN67qz3UpqxjWpyoKkRQ==',key_name='tempest-keypair-622025030',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-gr5a7kt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG os_vif [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ac3c99f-65, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:08:17 user nova-compute[72000]: INFO os_vif [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65')
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Start _get_guest_xml network_info=[{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.objects.instance [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'numa_topology' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:17 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:08:17 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.objects.instance [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1089625936',display_name='tempest-AttachVolumeTestJSON-server-1089625936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1089625936',id=5,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErb04qZpbsRut/09YXjqZYrtOHdBhP2tPvZwbKrovgBjHoU1dEbeqloQimLOszuW/qVazGtyEHJi8FlrHeWujg55/6v8atkLH5KmnvoByesgAKN67qz3UpqxjWpyoKkRQ==',key_name='tempest-keypair-622025030',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-gr5a7kt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.objects.instance [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:08:17 user nova-compute[72000]:   <uuid>f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c</uuid>
Aug 16 18:08:17 user nova-compute[72000]:   <name>instance-00000005</name>
Aug 16 18:08:17 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:08:17 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:08:17 user nova-compute[72000]:   <metadata>
Aug 16 18:08:17 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:08:17 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:08:17 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeTestJSON-server-1089625936</nova:name>
Aug 16 18:08:17 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:08:17</nova:creationTime>
Aug 16 18:08:17 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:08:17 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:08:17 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:08:17 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:08:17 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:08:17 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:08:17 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:08:17 user nova-compute[72000]:       <nova:owner>
Aug 16 18:08:17 user nova-compute[72000]:         <nova:user uuid="6df288fb86024b8d8a10bb0d0049e499">tempest-AttachVolumeTestJSON-120427729-project-member</nova:user>
Aug 16 18:08:17 user nova-compute[72000]:         <nova:project uuid="fcae1940950a4007898ba8d8ca6de402">tempest-AttachVolumeTestJSON-120427729</nova:project>
Aug 16 18:08:17 user nova-compute[72000]:       </nova:owner>
Aug 16 18:08:17 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:08:17 user nova-compute[72000]:       <nova:ports>
Aug 16 18:08:17 user nova-compute[72000]:         <nova:port uuid="2ac3c99f-65bd-4aaa-899d-41ec43d44906">
Aug 16 18:08:17 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 18:08:17 user nova-compute[72000]:         </nova:port>
Aug 16 18:08:17 user nova-compute[72000]:       </nova:ports>
Aug 16 18:08:17 user nova-compute[72000]:     </nova:instance>
Aug 16 18:08:17 user nova-compute[72000]:   </metadata>
Aug 16 18:08:17 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:08:17 user nova-compute[72000]:     <system>
Aug 16 18:08:17 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:08:17 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:08:17 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:08:17 user nova-compute[72000]:       <entry name="serial">f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c</entry>
Aug 16 18:08:17 user nova-compute[72000]:       <entry name="uuid">f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c</entry>
Aug 16 18:08:17 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:08:17 user nova-compute[72000]:     </system>
Aug 16 18:08:17 user nova-compute[72000]:   </sysinfo>
Aug 16 18:08:17 user nova-compute[72000]:   <os>
Aug 16 18:08:17 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:08:17 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:08:17 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:08:17 user nova-compute[72000]:   </os>
Aug 16 18:08:17 user nova-compute[72000]:   <features>
Aug 16 18:08:17 user nova-compute[72000]:     <acpi/>
Aug 16 18:08:17 user nova-compute[72000]:     <apic/>
Aug 16 18:08:17 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:08:17 user nova-compute[72000]:   </features>
Aug 16 18:08:17 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:08:17 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:08:17 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:08:17 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:08:17 user nova-compute[72000]:   </clock>
Aug 16 18:08:17 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:08:17 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:08:17 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:08:17 user nova-compute[72000]:   </cpu>
Aug 16 18:08:17 user nova-compute[72000]:   <devices>
Aug 16 18:08:17 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:08:17 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:08:17 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk"/>
Aug 16 18:08:17 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:08:17 user nova-compute[72000]:     </disk>
Aug 16 18:08:17 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:08:17 user nova-compute[72000]:       <mac address="fa:16:3e:e1:0f:ec"/>
Aug 16 18:08:17 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:08:17 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:08:17 user nova-compute[72000]:       <target dev="tap2ac3c99f-65"/>
Aug 16 18:08:17 user nova-compute[72000]:     </interface>
Aug 16 18:08:17 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:08:17 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/console.log" append="off"/>
Aug 16 18:08:17 user nova-compute[72000]:     </serial>
Aug 16 18:08:17 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:08:17 user nova-compute[72000]:     <video>
Aug 16 18:08:17 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:08:17 user nova-compute[72000]:     </video>
Aug 16 18:08:17 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:08:17 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:08:17 user nova-compute[72000]:     </rng>
Aug 16 18:08:17 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:08:17 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:08:17 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:08:17 user nova-compute[72000]:     </memballoon>
Aug 16 18:08:17 user nova-compute[72000]:   </devices>
Aug 16 18:08:17 user nova-compute[72000]: </domain>
Aug 16 18:08:17 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG nova.objects.instance [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'trusted_certs' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209283.329771, d76a0b56-0337-45a0-96db-83c267d5d649 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:08:18 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] VM Stopped (Lifecycle Event)
Aug 16 18:08:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-769c70be-5803-4e20-a427-79fa511f51c7 None None] [instance: d76a0b56-0337-45a0-96db-83c267d5d649] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Cannot resize image /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG nova.objects.instance [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'migration_context' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1089625936',display_name='tempest-AttachVolumeTestJSON-server-1089625936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1089625936',id=5,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErb04qZpbsRut/09YXjqZYrtOHdBhP2tPvZwbKrovgBjHoU1dEbeqloQimLOszuW/qVazGtyEHJi8FlrHeWujg55/6v8atkLH5KmnvoByesgAKN67qz3UpqxjWpyoKkRQ==',key_name='tempest-keypair-622025030',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-gr5a7kt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG os_vif [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ac3c99f-65, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ac3c99f-65, col_values=(('external_ids', {'iface-id': '2ac3c99f-65bd-4aaa-899d-41ec43d44906', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:0f:ec', 'vm-uuid': 'f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:08:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:18 user nova-compute[72000]: INFO os_vif [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65')
Aug 16 18:08:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-49728bda-dcee-4f27-acc1-38ed549dcccb req-2deac5ee-9622-4dd3-a1dc-605744e06c58 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:08:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-49728bda-dcee-4f27-acc1-38ed549dcccb req-2deac5ee-9622-4dd3-a1dc-605744e06c58 service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-49728bda-dcee-4f27-acc1-38ed549dcccb req-2deac5ee-9622-4dd3-a1dc-605744e06c58 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-49728bda-dcee-4f27-acc1-38ed549dcccb req-2deac5ee-9622-4dd3-a1dc-605744e06c58 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-49728bda-dcee-4f27-acc1-38ed549dcccb req-2deac5ee-9622-4dd3-a1dc-605744e06c58 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:08:20 user nova-compute[72000]: WARNING nova.compute.manager [req-49728bda-dcee-4f27-acc1-38ed549dcccb req-2deac5ee-9622-4dd3-a1dc-605744e06c58 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state stopped and task_state powering-on.
Aug 16 18:08:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:08:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:08:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:08:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:08:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:08:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:08:21 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [{"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-a8532341-62b3-4c58-b3d8-db5440ad08c3" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-62c6d7d4-6c60-41d1-8ec7-bf7408a2597f req-f240b6e3-8a72-479e-9d11-394bde7d68e1 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-62c6d7d4-6c60-41d1-8ec7-bf7408a2597f req-f240b6e3-8a72-479e-9d11-394bde7d68e1 service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-62c6d7d4-6c60-41d1-8ec7-bf7408a2597f req-f240b6e3-8a72-479e-9d11-394bde7d68e1 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-62c6d7d4-6c60-41d1-8ec7-bf7408a2597f req-f240b6e3-8a72-479e-9d11-394bde7d68e1 service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-62c6d7d4-6c60-41d1-8ec7-bf7408a2597f req-f240b6e3-8a72-479e-9d11-394bde7d68e1 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:08:22 user nova-compute[72000]: WARNING nova.compute.manager [req-62c6d7d4-6c60-41d1-8ec7-bf7408a2597f req-f240b6e3-8a72-479e-9d11-394bde7d68e1 service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state stopped and task_state powering-on.
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209302.186685, f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:08:22 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] VM Resumed (Lifecycle Event)
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:08:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance rebooted successfully.
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2de27283-f0d7-46ef-9719-142c1c0edbba tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:08:22 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209302.1870618, f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:08:22 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] VM Started (Lifecycle Event)
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-b06291b1-08c0-4503-82b9-d6b09a03bcea req-5799154b-5f69-4e26-9e20-a61b05400c38 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-changed-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-b06291b1-08c0-4503-82b9-d6b09a03bcea req-5799154b-5f69-4e26-9e20-a61b05400c38 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Refreshing instance network info cache due to event network-changed-570f94a4-3d2e-44e9-931f-147ee993a9e2. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b06291b1-08c0-4503-82b9-d6b09a03bcea req-5799154b-5f69-4e26-9e20-a61b05400c38 service nova] Acquiring lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b06291b1-08c0-4503-82b9-d6b09a03bcea req-5799154b-5f69-4e26-9e20-a61b05400c38 service nova] Acquired lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:08:24 user nova-compute[72000]: DEBUG nova.network.neutron [req-b06291b1-08c0-4503-82b9-d6b09a03bcea req-5799154b-5f69-4e26-9e20-a61b05400c38 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Refreshing network info cache for port 570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG nova.network.neutron [req-b06291b1-08c0-4503-82b9-d6b09a03bcea req-5799154b-5f69-4e26-9e20-a61b05400c38 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updated VIF entry in instance network info cache for port 570f94a4-3d2e-44e9-931f-147ee993a9e2. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG nova.network.neutron [req-b06291b1-08c0-4503-82b9-d6b09a03bcea req-5799154b-5f69-4e26-9e20-a61b05400c38 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updating instance_info_cache with network_info: [{"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b06291b1-08c0-4503-82b9-d6b09a03bcea req-5799154b-5f69-4e26-9e20-a61b05400c38 service nova] Releasing lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:08:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:08:26 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:08:26 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7367MB free_disk=23.94794464111328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a8532341-62b3-4c58-b3d8-db5440ad08c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f5fc020a-3be1-4e78-8825-89f06406e945 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:08:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:32 user nova-compute[72000]: INFO nova.compute.manager [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Shelving
Aug 16 18:08:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG nova.compute.manager [req-81b7b985-004b-471b-b611-8ec41bd2b225 req-e9a7b579-9db6-48f5-a635-faa81e125076 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-vif-unplugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-81b7b985-004b-471b-b611-8ec41bd2b225 req-e9a7b579-9db6-48f5-a635-faa81e125076 service nova] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-81b7b985-004b-471b-b611-8ec41bd2b225 req-e9a7b579-9db6-48f5-a635-faa81e125076 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-81b7b985-004b-471b-b611-8ec41bd2b225 req-e9a7b579-9db6-48f5-a635-faa81e125076 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG nova.compute.manager [req-81b7b985-004b-471b-b611-8ec41bd2b225 req-e9a7b579-9db6-48f5-a635-faa81e125076 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] No waiting events found dispatching network-vif-unplugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:08:33 user nova-compute[72000]: WARNING nova.compute.manager [req-81b7b985-004b-471b-b611-8ec41bd2b225 req-e9a7b579-9db6-48f5-a635-faa81e125076 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received unexpected event network-vif-unplugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 for instance with vm_state active and task_state shelving.
Aug 16 18:08:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:33 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Instance destroyed successfully.
Aug 16 18:08:33 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Beginning cold snapshot process
Aug 16 18:08:33 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:08:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk /opt/stack/data/nova/instances/snapshots/tmp1_2ltaqg/bbe08066399d48e0b93fae53ec05d672 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:08:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk /opt/stack/data/nova/instances/snapshots/tmp1_2ltaqg/bbe08066399d48e0b93fae53ec05d672" returned: 0 in 1.029s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:08:34 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Snapshot extracted, beginning image upload
Aug 16 18:08:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-11f2be67-7a38-4072-bc4b-6b85207a3dbc req-638cec8e-d339-4493-a0cf-8ed5f532a501 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:08:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-11f2be67-7a38-4072-bc4b-6b85207a3dbc req-638cec8e-d339-4493-a0cf-8ed5f532a501 service nova] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-11f2be67-7a38-4072-bc4b-6b85207a3dbc req-638cec8e-d339-4493-a0cf-8ed5f532a501 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-11f2be67-7a38-4072-bc4b-6b85207a3dbc req-638cec8e-d339-4493-a0cf-8ed5f532a501 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-11f2be67-7a38-4072-bc4b-6b85207a3dbc req-638cec8e-d339-4493-a0cf-8ed5f532a501 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] No waiting events found dispatching network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:08:35 user nova-compute[72000]: WARNING nova.compute.manager [req-11f2be67-7a38-4072-bc4b-6b85207a3dbc req-638cec8e-d339-4493-a0cf-8ed5f532a501 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received unexpected event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 18:08:37 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Snapshot image upload complete
Aug 16 18:08:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:08:37 user nova-compute[72000]: INFO nova.compute.manager [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Shelve offloading
Aug 16 18:08:37 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Instance destroyed successfully.
Aug 16 18:08:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:08:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:08:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquired lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:08:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:08:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updating instance_info_cache with network_info: [{"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:08:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Releasing lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:38 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Instance destroyed successfully.
Aug 16 18:08:38 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'resources' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2067903681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2067903681',id=20,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzAIQ4Qj/buGVYTF9Q5oTXmTmubqVmbfas/Gwlki1gZXYF6B7LxmZeceF68CptfGwnNe4ghrEiOtNYM248dcgGpuXQVyEeF0szdyiRkBTm+GkDoH8E6uKhsqsrzOoZwgg==',key_name='tempest-keypair-627413116',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:06:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-zfoj5n1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member',shelved_at='2023-08-16T18:08:37.290427',shelved_host='user',shelved_image_id='7d69c5e5-b79e-48ac-9e60-2ff12ac2d4c2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:08:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=35f9ef3c-4dd4-431b-997c-7c0f91d035cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG os_vif [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap570f94a4-3d, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-29bbe0e7-c6db-4de5-a164-01b5aba6b7d9 req-bc93c9c0-924d-4e86-8f30-b1685e8aa49c service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-changed-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-29bbe0e7-c6db-4de5-a164-01b5aba6b7d9 req-bc93c9c0-924d-4e86-8f30-b1685e8aa49c service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Refreshing instance network info cache due to event network-changed-570f94a4-3d2e-44e9-931f-147ee993a9e2. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-29bbe0e7-c6db-4de5-a164-01b5aba6b7d9 req-bc93c9c0-924d-4e86-8f30-b1685e8aa49c service nova] Acquiring lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-29bbe0e7-c6db-4de5-a164-01b5aba6b7d9 req-bc93c9c0-924d-4e86-8f30-b1685e8aa49c service nova] Acquired lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG nova.network.neutron [req-29bbe0e7-c6db-4de5-a164-01b5aba6b7d9 req-bc93c9c0-924d-4e86-8f30-b1685e8aa49c service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Refreshing network info cache for port 570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:08:38 user nova-compute[72000]: INFO os_vif [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d')
Aug 16 18:08:38 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Deleting instance files /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd_del
Aug 16 18:08:38 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Deletion of /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd_del complete
Aug 16 18:08:38 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Deleted allocations for instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd
Aug 16 18:08:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:08:38 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'numa_topology' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:08:39 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:08:39 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:08:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a75895fd-e4c7-4ca7-b679-54ebee35abd8 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.176s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:08:39 user nova-compute[72000]: DEBUG nova.network.neutron [req-29bbe0e7-c6db-4de5-a164-01b5aba6b7d9 req-bc93c9c0-924d-4e86-8f30-b1685e8aa49c service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updated VIF entry in instance network info cache for port 570f94a4-3d2e-44e9-931f-147ee993a9e2. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:08:39 user nova-compute[72000]: DEBUG nova.network.neutron [req-29bbe0e7-c6db-4de5-a164-01b5aba6b7d9 req-bc93c9c0-924d-4e86-8f30-b1685e8aa49c service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updating instance_info_cache with network_info: [{"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap570f94a4-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:08:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-29bbe0e7-c6db-4de5-a164-01b5aba6b7d9 req-bc93c9c0-924d-4e86-8f30-b1685e8aa49c service nova] Releasing lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:08:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:48 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209313.6081972, 35f9ef3c-4dd4-431b-997c-7c0f91d035cd => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:08:48 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] VM Stopped (Lifecycle Event)
Aug 16 18:08:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-eb69a065-6308-44a8-be9b-6bfca11c08f2 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:08:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:08:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-bfc27aa0-821a-47fa-bdbc-8c21c897d956 req-8f3e41a7-da84-448b-b65c-2415006216e2 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-changed-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-bfc27aa0-821a-47fa-bdbc-8c21c897d956 req-8f3e41a7-da84-448b-b65c-2415006216e2 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing instance network info cache due to event network-changed-cf295ae9-9926-431c-8b42-7be3820eee21. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:09:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bfc27aa0-821a-47fa-bdbc-8c21c897d956 req-8f3e41a7-da84-448b-b65c-2415006216e2 service nova] Acquiring lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:09:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bfc27aa0-821a-47fa-bdbc-8c21c897d956 req-8f3e41a7-da84-448b-b65c-2415006216e2 service nova] Acquired lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:09:07 user nova-compute[72000]: DEBUG nova.network.neutron [req-bfc27aa0-821a-47fa-bdbc-8c21c897d956 req-8f3e41a7-da84-448b-b65c-2415006216e2 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Refreshing network info cache for port cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:09:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-bfc27aa0-821a-47fa-bdbc-8c21c897d956 req-8f3e41a7-da84-448b-b65c-2415006216e2 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updated VIF entry in instance network info cache for port cf295ae9-9926-431c-8b42-7be3820eee21. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:09:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-bfc27aa0-821a-47fa-bdbc-8c21c897d956 req-8f3e41a7-da84-448b-b65c-2415006216e2 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [{"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bfc27aa0-821a-47fa-bdbc-8c21c897d956 req-8f3e41a7-da84-448b-b65c-2415006216e2 service nova] Releasing lock "refresh_cache-d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:09:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:10 user nova-compute[72000]: INFO nova.compute.manager [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Terminating instance
Aug 16 18:09:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-83edef7a-5652-4912-9979-0f075ccd3820 req-2786adb3-8791-4b07-aab1-4e7c2484f06a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-83edef7a-5652-4912-9979-0f075ccd3820 req-2786adb3-8791-4b07-aab1-4e7c2484f06a service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-83edef7a-5652-4912-9979-0f075ccd3820 req-2786adb3-8791-4b07-aab1-4e7c2484f06a service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-83edef7a-5652-4912-9979-0f075ccd3820 req-2786adb3-8791-4b07-aab1-4e7c2484f06a service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-83edef7a-5652-4912-9979-0f075ccd3820 req-2786adb3-8791-4b07-aab1-4e7c2484f06a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-unplugged-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-83edef7a-5652-4912-9979-0f075ccd3820 req-2786adb3-8791-4b07-aab1-4e7c2484f06a service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-cf295ae9-9926-431c-8b42-7be3820eee21 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-03ec30d0-bcc9-4993-bde7-80d391e29441 req-747ee7d9-141e-4420-b90a-3cd5f38062b8 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-03ec30d0-bcc9-4993-bde7-80d391e29441 req-747ee7d9-141e-4420-b90a-3cd5f38062b8 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-03ec30d0-bcc9-4993-bde7-80d391e29441 req-747ee7d9-141e-4420-b90a-3cd5f38062b8 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-03ec30d0-bcc9-4993-bde7-80d391e29441 req-747ee7d9-141e-4420-b90a-3cd5f38062b8 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-03ec30d0-bcc9-4993-bde7-80d391e29441 req-747ee7d9-141e-4420-b90a-3cd5f38062b8 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-unplugged-edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-03ec30d0-bcc9-4993-bde7-80d391e29441 req-747ee7d9-141e-4420-b90a-3cd5f38062b8 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-edd566b2-37d8-49b0-9c69-e35d9de5833e for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-34d5ca3c-9a2f-42b7-aa70-9505de906536 req-df563ac9-5116-46ba-9471-a48fadb573e7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-34d5ca3c-9a2f-42b7-aa70-9505de906536 req-df563ac9-5116-46ba-9471-a48fadb573e7 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-34d5ca3c-9a2f-42b7-aa70-9505de906536 req-df563ac9-5116-46ba-9471-a48fadb573e7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-34d5ca3c-9a2f-42b7-aa70-9505de906536 req-df563ac9-5116-46ba-9471-a48fadb573e7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-34d5ca3c-9a2f-42b7-aa70-9505de906536 req-df563ac9-5116-46ba-9471-a48fadb573e7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-unplugged-c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-34d5ca3c-9a2f-42b7-aa70-9505de906536 req-df563ac9-5116-46ba-9471-a48fadb573e7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-c803184c-44f7-48cc-aead-7e7ef312d397 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:09:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Instance destroyed successfully.
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.objects.instance [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lazy-loading 'resources' on Instance uuid d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:30:32,bridge_name='br-int',has_traffic_filtering=True,id=cf295ae9-9926-431c-8b42-7be3820eee21,network=Network(cdd13d99-07bb-4651-8501-0b655d123a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf295ae9-99') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:30:32,bridge_name='br-int',has_traffic_filtering=True,id=cf295ae9-9926-431c-8b42-7be3820eee21,network=Network(cdd13d99-07bb-4651-8501-0b655d123a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf295ae9-99') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf295ae9-99, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: INFO os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:30:32,bridge_name='br-int',has_traffic_filtering=True,id=cf295ae9-9926-431c-8b42-7be3820eee21,network=Network(cdd13d99-07bb-4651-8501-0b655d123a4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf295ae9-99')
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:7c:06,bridge_name='br-int',has_traffic_filtering=True,id=edd566b2-37d8-49b0-9c69-e35d9de5833e,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedd566b2-37') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:7c:06,bridge_name='br-int',has_traffic_filtering=True,id=edd566b2-37d8-49b0-9c69-e35d9de5833e,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedd566b2-37') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedd566b2-37, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: INFO os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:7c:06,bridge_name='br-int',has_traffic_filtering=True,id=edd566b2-37d8-49b0-9c69-e35d9de5833e,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapedd566b2-37')
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:9c:95,bridge_name='br-int',has_traffic_filtering=True,id=c803184c-44f7-48cc-aead-7e7ef312d397,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc803184c-44') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:9c:95,bridge_name='br-int',has_traffic_filtering=True,id=c803184c-44f7-48cc-aead-7e7ef312d397,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc803184c-44') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc803184c-44, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: INFO os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:9c:95,bridge_name='br-int',has_traffic_filtering=True,id=c803184c-44f7-48cc-aead-7e7ef312d397,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc803184c-44')
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:89:12,bridge_name='br-int',has_traffic_filtering=True,id=f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dbe6f9-25') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:89:12,bridge_name='br-int',has_traffic_filtering=True,id=f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dbe6f9-25') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9dbe6f9-25, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: INFO os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:89:12,bridge_name='br-int',has_traffic_filtering=True,id=f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9dbe6f9-25')
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=20f0c252-2401-4fd8-9811-ce038433d723,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f0c252-24') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=20f0c252-2401-4fd8-9811-ce038433d723,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f0c252-24') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20f0c252-24, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: INFO os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:1e:fa,bridge_name='br-int',has_traffic_filtering=True,id=20f0c252-2401-4fd8-9811-ce038433d723,network=Network(505ef886-1399-47da-b8b9-81c59e1f7979),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20f0c252-24')
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:61:36,bridge_name='br-int',has_traffic_filtering=True,id=5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3351e7-8f') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:61:36,bridge_name='br-int',has_traffic_filtering=True,id=5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3351e7-8f') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e3351e7-8f, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: INFO os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:61:36,bridge_name='br-int',has_traffic_filtering=True,id=5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3351e7-8f')
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-16T18:06:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-357790648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-357790648',id=19,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5ahlxTivOKvde6yxZXlaTeno0rItjuhVJr0ZpTkASJqD2ctLLmci2dPeq/p7AWtnM9A8AtBeyab6xfhjqVB0HEZV5JZlERXcTWdWzjpyvngw5xoAya2Vz51lq6QODGWg==',key_name='tempest-keypair-1578377296',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df15c3db43cb4d6b925b43632d88617a',ramdisk_id='',reservation_id='r-yivtadad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1049065283',owner_user_name='tempest-TaggedBootDevicesTest-1049065283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8dd1f88737aa49e3b635f8e3dbf4d025',uuid=d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converting VIF {"id": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "address": "fa:16:3e:81:a5:02", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8dae8097-fb", "ovs_interfaceid": "8dae8097-fbe9-439d-a321-f7ef4e14b57a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:02,bridge_name='br-int',has_traffic_filtering=True,id=8dae8097-fbe9-439d-a321-f7ef4e14b57a,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dae8097-fb') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:02,bridge_name='br-int',has_traffic_filtering=True,id=8dae8097-fbe9-439d-a321-f7ef4e14b57a,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dae8097-fb') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8dae8097-fb, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:09:12 user nova-compute[72000]: INFO os_vif [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a5:02,bridge_name='br-int',has_traffic_filtering=True,id=8dae8097-fbe9-439d-a321-f7ef4e14b57a,network=Network(206b1ca7-c511-4e10-badf-3af62545f167),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8dae8097-fb')
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLHiIDBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:09:12 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6da36bf-789d-49c4-8d59-d10894eac349]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dc8a1e-26c8-4e3c-87e3-7eec1c22e8ad]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:09:12 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:09:12 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:09:12 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:09:12 user nova-compute[72000]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:09:12 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:09:12 user nova-compute[72000]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 (non-flash)
Aug 16 18:09:12 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:09:12 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:09:12 user nova-compute[72000]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:09:12 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd019d34280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9f004-8343-4dce-9701-9938044b2eef]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3587efbe-c055-44c4-8dea-768698d999c5]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1f42b0-ad77-4f8b-bd10-87b528792e74]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "f5fc020a-3be1-4e78-8825-89f06406e945" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:12 user nova-compute[72000]: INFO nova.compute.manager [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Terminating instance
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1143965c-b0aa-4083-9ae8-3557713903a9]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5160f3-eafd-4646-92d8-9d587036394b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-c6c3eb91-c8a0-4a5e-a81d-38144e52d129 req-56e5efc8-7a61-499f-aa0d-d37b48fc60d9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c6c3eb91-c8a0-4a5e-a81d-38144e52d129 req-56e5efc8-7a61-499f-aa0d-d37b48fc60d9 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c6c3eb91-c8a0-4a5e-a81d-38144e52d129 req-56e5efc8-7a61-499f-aa0d-d37b48fc60d9 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c6c3eb91-c8a0-4a5e-a81d-38144e52d129 req-56e5efc8-7a61-499f-aa0d-d37b48fc60d9 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-c6c3eb91-c8a0-4a5e-a81d-38144e52d129 req-56e5efc8-7a61-499f-aa0d-d37b48fc60d9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:12 user nova-compute[72000]: WARNING nova.compute.manager [req-c6c3eb91-c8a0-4a5e-a81d-38144e52d129 req-56e5efc8-7a61-499f-aa0d-d37b48fc60d9 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-cf295ae9-9926-431c-8b42-7be3820eee21 for instance with vm_state active and task_state deleting.
Aug 16 18:09:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.112s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fda015-ecb4-4517-a0ce-fc56fd9f7d56]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5, portal: 172.16.0.220,3260]
Aug 16 18:09:12 user nova-compute[72000]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5, portal: 172.16.0.220,3260] successful.
Aug 16 18:09:12 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3cc35d-082a-456a-982b-5d9e3e5a4ac5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b711405-96b8-47cc-ae73-1ca0f3b6f61d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] <== disconnect_volume: return (366ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SiVZcTWK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:09:12 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e788ea-849a-45c9-b639-d965f576527d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-edd566b2-37d8-49b0-9c69-e35d9de5833e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:13 user nova-compute[72000]: WARNING nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-edd566b2-37d8-49b0-9c69-e35d9de5833e for instance with vm_state active and task_state deleting.
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-unplugged-20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-20f0c252-2401-4fd8-9811-ce038433d723 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:13 user nova-compute[72000]: WARNING nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-20f0c252-2401-4fd8-9811-ce038433d723 for instance with vm_state active and task_state deleting.
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-changed-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Refreshing instance network info cache due to event network-changed-ff6674fb-0507-4b0e-a63e-b541fa45d07e. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Acquiring lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Acquired lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.network.neutron [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Refreshing network info cache for port ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58239a-54bb-483b-92a3-5a357d4d310d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-c803184c-44f7-48cc-aead-7e7ef312d397 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:13 user nova-compute[72000]: WARNING nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-c803184c-44f7-48cc-aead-7e7ef312d397 for instance with vm_state active and task_state deleting.
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-unplugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:13 user nova-compute[72000]: WARNING nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 for instance with vm_state active and task_state deleting.
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-unplugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:13 user nova-compute[72000]: WARNING nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 for instance with vm_state active and task_state deleting.
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-unplugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-unplugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-plugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Acquiring lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] No waiting events found dispatching network-vif-plugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:13 user nova-compute[72000]: WARNING nova.compute.manager [req-5c2d6f5f-a451-45b8-acd8-5b55e64f4d2d req-961c0275-3dfb-4eef-8563-abfc3ea458c7 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received unexpected event network-vif-plugged-8dae8097-fbe9-439d-a321-f7ef4e14b57a for instance with vm_state active and task_state deleting.
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:09:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:09:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0082efac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e'): ({'sdd'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Removing single pathed devices sdd {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c32ddf-d256-4aec-8a04-eea7755cf76f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf8a9d5-94a7-432b-9b69-87c3771f606d]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Flushing IO for device /dev/sdd {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[68453a42-20fc-4ed1-8037-e31c13b05371]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[835e455c-8db5-4f5e-8907-28446f326fd9]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b8b5c7-8cf8-4921-a757-514556f8cf04]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[da86d3fc-3f92-4718-a1ae-37c44f3dbfdc]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e, portal: 172.16.0.220,3260]
Aug 16 18:09:13 user nova-compute[72000]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e, portal: 172.16.0.220,3260] successful.
Aug 16 18:09:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b080a215-fa47-44d3-a3e1-3ca6995d820e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ca58c7-4cd4-4ea4-bcea-60c9bace857b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] <== disconnect_volume: return (329ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JcgtjbPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:09:13 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[890d08f0-178f-42f0-8166-31918ac823fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2567a0f2-22d1-498c-9cb3-987e0c476e3e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:09:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:09:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01c85d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36'): ({'sde'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Removing single pathed devices sde {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9a9cc6-6049-4a1f-b827-362d99744646]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a923b3-b19b-4be2-bf73-a4f1765a651d]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Flushing IO for device /dev/sde {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[14da8e63-b651-4fa4-ac1d-44776c1b9902]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Instance destroyed successfully.
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.objects.instance [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lazy-loading 'resources' on Instance uuid f5fc020a-3be1-4e78-8825-89f06406e945 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:03:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1671854720',display_name='tempest-TestShelveInstance-server-1671854720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1671854720',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy10SwZ4bXKRC0dKCPy6fa0uY+bnVm3aNRZ8sBCF4oDMA+nZgCk9jKcPb8d0QkfWiDIWgt1qbCCse8HMygOI1Yr5uM1Lf8XlRV1BZ+gXxaguTOxe6XXmYzzDCkeBftw0Q==',key_name='tempest-TestShelveInstance-381507571',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:07:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e70b32f569148f598a9ea19771d9d64',ramdisk_id='',reservation_id='r-4l1srynu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestShelveInstance-1203105608',owner_user_name='tempest-TestShelveInstance-1203105608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:41Z,user_data=None,user_id='7bafbe976da14bcca011f17b17ca65ff',uuid=f5fc020a-3be1-4e78-8825-89f06406e945,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converting VIF {"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_vif [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff6674fb-05, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e98633-f8ba-4552-8b6b-6b01f580babb]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf7c5d80d-f699ee6ac0bca7cf', '/dev/disk/by-id/scsi-26636393965653661', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f7c5d80d') {{(pid=83463) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65b06a7-dd18-40da-975b-dc0e4c62521a]: (4, None) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: INFO os_vif [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:c9:51,bridge_name='br-int',has_traffic_filtering=True,id=ff6674fb-0507-4b0e-a63e-b541fa45d07e,network=Network(6fb0849d-a080-4f10-8b42-fc919a1b449d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6674fb-05')
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HkFJdhxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:09:13 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d85f53e-4273-456b-9a65-145cbd186a77]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.network.neutron [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updated VIF entry in instance network info cache for port ff6674fb-0507-4b0e-a63e-b541fa45d07e. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.network.neutron [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating instance_info_cache with network_info: [{"id": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "address": "fa:16:3e:92:c9:51", "network": {"id": "6fb0849d-a080-4f10-8b42-fc919a1b449d", "bridge": "br-int", "label": "tempest-TestShelveInstance-874152742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e70b32f569148f598a9ea19771d9d64", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6674fb-05", "ovs_interfaceid": "ff6674fb-0507-4b0e-a63e-b541fa45d07e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0173af6f-9033-45ca-a6ea-61dc666bf40e req-2df3a07c-08be-4311-851a-73ce00a46a77 service nova] Releasing lock "refresh_cache-f5fc020a-3be1-4e78-8825-89f06406e945" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0cfc01-3604-4aea-97ba-e07b773fe24a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36, portal: 172.16.0.220,3260]
Aug 16 18:09:13 user nova-compute[72000]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36, portal: 172.16.0.220,3260] successful.
Aug 16 18:09:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:785e7214-45bc-4d8e-b8fe-351099f6fa36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8385286f-c9bd-4142-8657-d84e0cb556e9]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] <== disconnect_volume: return (348ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:09:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Deleting instance files /opt/stack/data/nova/instances/d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7_del
Aug 16 18:09:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Deletion of /opt/stack/data/nova/instances/d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7_del complete
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.129s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ce6435-ccb4-4c16-9d33-86467b7bdc2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac48fcb-cb1f-4bbc-a4fd-c4a20796d7d9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:09:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:09:13 user nova-compute[72000]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 (non-flash)
Aug 16 18:09:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0082ed750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8'): ({'sdf'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Removing single pathed devices sdf {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: INFO nova.compute.manager [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Took 3.32 seconds to destroy the instance on the hypervisor.
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef5a19e-940e-4dfd-af9d-c256d41fc5a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[71898aab-c6e4-458e-a917-ab5f6cadf93c]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Flushing IO for device /dev/sdf {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ad0858-31a0-4d29-ba8b-31e30d8cc5c6]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b350d0-bc7b-4307-8525-6a3df448a0ed]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] SCSI volumes sdf have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4d842888-3d2b3b58a3f295ca', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4d842888', '/dev/disk/by-id/scsi-23364326233623538') {{(pid=83463) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af0b6e3-20b5-48e1-826e-c37e1e46dcae]: (4, None) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[938701a8-8e2d-40b9-9302-59903456e413]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2e15ad-0111-4c2b-be55-deedef820479]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260]
Aug 16 18:09:13 user nova-compute[72000]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8, portal: 172.16.0.220,3260] successful.
Aug 16 18:09:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66a71622-9305-481d-b3f1-ae05f26abde8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[056d6c42-7544-4e6b-b06d-adcca9601825]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] <== disconnect_volume: return (435ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:09:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:09:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Deleting instance files /opt/stack/data/nova/instances/f5fc020a-3be1-4e78-8825-89f06406e945_del
Aug 16 18:09:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Deletion of /opt/stack/data/nova/instances/f5fc020a-3be1-4e78-8825-89f06406e945_del complete
Aug 16 18:09:14 user nova-compute[72000]: INFO nova.compute.manager [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 16 18:09:14 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:14 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Took 0.72 seconds to deallocate network for instance.
Aug 16 18:09:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-vif-unplugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] No waiting events found dispatching network-vif-unplugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-vif-unplugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] Acquiring lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] Lock "f5fc020a-3be1-4e78-8825-89f06406e945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] No waiting events found dispatching network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:14 user nova-compute[72000]: WARNING nova.compute.manager [req-e6abf2c6-188d-440e-8faf-b11f35ff137d req-ca32a947-0fa9-4508-8654-2523e0fe57d4 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received unexpected event network-vif-plugged-ff6674fb-0507-4b0e-a63e-b541fa45d07e for instance with vm_state active and task_state deleting.
Aug 16 18:09:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-dba1ce11-8edb-4b6a-a933-1a5f9a68d3bb req-4f975822-adeb-47ff-8182-82d968c387d1 service nova] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Received event network-vif-deleted-ff6674fb-0507-4b0e-a63e-b541fa45d07e {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:15 user nova-compute[72000]: INFO nova.compute.manager [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Took 0.91 seconds to detach 1 volumes for instance.
Aug 16 18:09:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Deleting volume: 66a71622-9305-481d-b3f1-ae05f26abde8 {{(pid=72000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 18:09:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:16 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:09:16 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:09:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:16 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Deleted allocations for instance f5fc020a-3be1-4e78-8825-89f06406e945
Aug 16 18:09:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-44881f3b-27f5-481d-a916-0ca265e7f83f tempest-TestShelveInstance-1203105608 tempest-TestShelveInstance-1203105608-project-member] Lock "f5fc020a-3be1-4e78-8825-89f06406e945" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.579s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-8edca8d6-bd09-4e82-b9cc-ca09eafd99a1 req-167311fe-7949-44a4-ae23-64198221ea10 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-deleted-8dae8097-fbe9-439d-a321-f7ef4e14b57a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:16 user nova-compute[72000]: INFO nova.compute.manager [req-8edca8d6-bd09-4e82-b9cc-ca09eafd99a1 req-167311fe-7949-44a4-ae23-64198221ea10 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Neutron deleted interface 8dae8097-fbe9-439d-a321-f7ef4e14b57a; detaching it from the instance and deleting it from the info cache
Aug 16 18:09:16 user nova-compute[72000]: DEBUG nova.network.neutron [req-8edca8d6-bd09-4e82-b9cc-ca09eafd99a1 req-167311fe-7949-44a4-ae23-64198221ea10 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [{"id": "cf295ae9-9926-431c-8b42-7be3820eee21", "address": "fa:16:3e:d8:30:32", "network": {"id": "cdd13d99-07bb-4651-8501-0b655d123a4b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-392744954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf295ae9-99", "ovs_interfaceid": "cf295ae9-9926-431c-8b42-7be3820eee21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "address": "fa:16:3e:2f:7c:06", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd566b2-37", "ovs_interfaceid": "edd566b2-37d8-49b0-9c69-e35d9de5833e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c803184c-44f7-48cc-aead-7e7ef312d397", "address": "fa:16:3e:53:9c:95", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc803184c-44", "ovs_interfaceid": "c803184c-44f7-48cc-aead-7e7ef312d397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "address": "fa:16:3e:69:89:12", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9dbe6f9-25", "ovs_interfaceid": "f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20f0c252-2401-4fd8-9811-ce038433d723", "address": "fa:16:3e:3b:1e:fa", "network": {"id": "505ef886-1399-47da-b8b9-81c59e1f7979", "bridge": "br-int", "label": "tempest-device-tagging-net1-22665539", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20f0c252-24", "ovs_interfaceid": "20f0c252-2401-4fd8-9811-ce038433d723", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "address": "fa:16:3e:a8:61:36", "network": {"id": "206b1ca7-c511-4e10-badf-3af62545f167", "bridge": "br-int", "label": "tempest-device-tagging-net2-719943277", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "df15c3db43cb4d6b925b43632d88617a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3351e7-8f", "ovs_interfaceid": "5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-8edca8d6-bd09-4e82-b9cc-ca09eafd99a1 req-167311fe-7949-44a4-ae23-64198221ea10 service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Detach interface failed, port_id=8dae8097-fbe9-439d-a321-f7ef4e14b57a, reason: Instance d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:09:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:18 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:18 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Took 5.08 seconds to deallocate network for instance.
Aug 16 18:09:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6a48305-e73e-44ee-8bc8-e1e911f54152 req-69d77c4f-451f-4aa0-bccb-799a3a7087cf service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-deleted-cf295ae9-9926-431c-8b42-7be3820eee21 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6a48305-e73e-44ee-8bc8-e1e911f54152 req-69d77c4f-451f-4aa0-bccb-799a3a7087cf service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-deleted-20f0c252-2401-4fd8-9811-ce038433d723 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6a48305-e73e-44ee-8bc8-e1e911f54152 req-69d77c4f-451f-4aa0-bccb-799a3a7087cf service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-deleted-5e3351e7-8fc6-442f-a0d1-3b52ec73f7c7 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-e6a48305-e73e-44ee-8bc8-e1e911f54152 req-69d77c4f-451f-4aa0-bccb-799a3a7087cf service nova] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Received event network-vif-deleted-f9dbe6f9-2500-4cdb-819e-28dbc2f1d5a6 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:20 user nova-compute[72000]: INFO nova.compute.manager [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Terminating instance
Aug 16 18:09:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:09:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-f4e16000-f336-4106-a7fb-98c7ac3e79aa req-390754f5-357a-4e33-9a08-396053016a3b service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-unplugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f4e16000-f336-4106-a7fb-98c7ac3e79aa req-390754f5-357a-4e33-9a08-396053016a3b service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f4e16000-f336-4106-a7fb-98c7ac3e79aa req-390754f5-357a-4e33-9a08-396053016a3b service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f4e16000-f336-4106-a7fb-98c7ac3e79aa req-390754f5-357a-4e33-9a08-396053016a3b service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-f4e16000-f336-4106-a7fb-98c7ac3e79aa req-390754f5-357a-4e33-9a08-396053016a3b service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-unplugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-f4e16000-f336-4106-a7fb-98c7ac3e79aa req-390754f5-357a-4e33-9a08-396053016a3b service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-unplugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:09:21 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Instance destroyed successfully.
Aug 16 18:09:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lazy-loading 'resources' on Instance uuid a8532341-62b3-4c58-b3d8-db5440ad08c3 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-158489387',display_name='tempest-ServerActionsTestOtherB-server-158489387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-158489387',id=4,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrdiqOjF0w82oTGC6W8NyzHji/AAi+fARuYFDptSsxWEW2f7mWefGKfWyQtISbWHzqnq0YFbbPnDR8XKw6XPCJva4Yjg8+O3HxmlUuJZCmEJf2X0VZ0VVhtvx/qeQ8XoQ==',key_name='tempest-keypair-1407087314',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:07:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df523a13c0914e4ea7c2782d10e6535c',ramdisk_id='',reservation_id='r-hdgm4kha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-915732487',owner_user_name='tempest-ServerActionsTestOtherB-915732487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb202933952474c99d17811058efc7c',uuid=a8532341-62b3-4c58-b3d8-db5440ad08c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converting VIF {"id": "548341b0-47da-4962-b21a-fd4cc4118bdc", "address": "fa:16:3e:98:69:d9", "network": {"id": "479c0f1c-1477-4e4f-95b5-2230528a81e2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-864425115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df523a13c0914e4ea7c2782d10e6535c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap548341b0-47", "ovs_interfaceid": "548341b0-47da-4962-b21a-fd4cc4118bdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_vif [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap548341b0-47, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:21 user nova-compute[72000]: INFO os_vif [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:69:d9,bridge_name='br-int',has_traffic_filtering=True,id=548341b0-47da-4962-b21a-fd4cc4118bdc,network=Network(479c0f1c-1477-4e4f-95b5-2230528a81e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap548341b0-47')
Aug 16 18:09:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmFWTNRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:09:21 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[642e30a3-f859-4cd0-b8d5-09c87a6cab23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0519bd01-15c9-4e1e-98fb-2f1afe3b7978]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:09:21 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa (non-flash)
Aug 16 18:09:21 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0082ef7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb6ee8b-496f-4568-93ba-224b31060b82]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e3f9ef-8020-4fe4-bccc-3d1c48b61059]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[24701821-e105-4c87-a29a-98c7cfb32099]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cb8cd3-6032-4d4c-a6df-238545182354]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf9bf6c-e9ed-4b3d-90ba-91dc6291f6ee]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67ba134-b8a0-4b79-90c9-d8fc78087d0a]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260]
Aug 16 18:09:21 user nova-compute[72000]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa, portal: 172.16.0.220,3260] successful.
Aug 16 18:09:21 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a3bba8f-57f3-428b-87f7-c48a475f84fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[63890c71-07c1-4ca7-a07d-80e58ffb48c7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:09:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] <== disconnect_volume: return (272ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:09:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:09:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Deleting instance files /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3_del
Aug 16 18:09:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Deletion of /opt/stack/data/nova/instances/a8532341-62b3-4c58-b3d8-db5440ad08c3_del complete
Aug 16 18:09:22 user nova-compute[72000]: INFO nova.compute.manager [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 16 18:09:22 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:09:22 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:09:22 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:23 user nova-compute[72000]: INFO nova.compute.manager [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Terminating instance
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:23 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Took 1.02 seconds to deallocate network for instance.
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.compute.manager [req-942bece9-a497-4de9-b13d-dab850040495 req-d22e0c66-ab69-4d83-bff5-733a7693b4a6 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-deleted-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:23 user nova-compute[72000]: INFO nova.compute.manager [req-942bece9-a497-4de9-b13d-dab850040495 req-d22e0c66-ab69-4d83-bff5-733a7693b4a6 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Neutron deleted interface 548341b0-47da-4962-b21a-fd4cc4118bdc; detaching it from the instance and deleting it from the info cache
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.network.neutron [req-942bece9-a497-4de9-b13d-dab850040495 req-d22e0c66-ab69-4d83-bff5-733a7693b4a6 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.compute.manager [req-942bece9-a497-4de9-b13d-dab850040495 req-d22e0c66-ab69-4d83-bff5-733a7693b4a6 service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Detach interface failed, port_id=548341b0-47da-4962-b21a-fd4cc4118bdc, reason: Instance a8532341-62b3-4c58-b3d8-db5440ad08c3 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.compute.manager [req-22d7ddd5-a0c1-43a1-a62f-7030784558d3 req-d0ca56b6-7d56-42fc-a6f0-156b3bac57cd service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22d7ddd5-a0c1-43a1-a62f-7030784558d3 req-d0ca56b6-7d56-42fc-a6f0-156b3bac57cd service nova] Acquiring lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22d7ddd5-a0c1-43a1-a62f-7030784558d3 req-d0ca56b6-7d56-42fc-a6f0-156b3bac57cd service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22d7ddd5-a0c1-43a1-a62f-7030784558d3 req-d0ca56b6-7d56-42fc-a6f0-156b3bac57cd service nova] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.compute.manager [req-22d7ddd5-a0c1-43a1-a62f-7030784558d3 req-d0ca56b6-7d56-42fc-a6f0-156b3bac57cd service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] No waiting events found dispatching network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:23 user nova-compute[72000]: WARNING nova.compute.manager [req-22d7ddd5-a0c1-43a1-a62f-7030784558d3 req-d0ca56b6-7d56-42fc-a6f0-156b3bac57cd service nova] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Received unexpected event network-vif-plugged-548341b0-47da-4962-b21a-fd4cc4118bdc for instance with vm_state active and task_state deleting.
Aug 16 18:09:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Instance destroyed successfully.
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.objects.instance [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lazy-loading 'resources' on Instance uuid e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-947053866',display_name='tempest-ServersNegativeTestJSON-server-947053866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-947053866',id=2,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae4b7b47c8c9413d828928c6132eb104',ramdisk_id='',reservation_id='r-ccxdnos9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-764876388',owner_user_name='tempest-ServersNegativeTestJSON-764876388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:00:41Z,user_data=None,user_id='7d24985b850c46e3bdb31296af169a23',uuid=e6d1db4c-f1e7-4019-80c6-a9703ab18dc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converting VIF {"id": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "address": "fa:16:3e:17:58:3c", "network": {"id": "7ce99f7d-8859-4bc3-a102-1a170c3e1462", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-538641637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae4b7b47c8c9413d828928c6132eb104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7287a0-44", "ovs_interfaceid": "6b7287a0-44f1-4148-83ce-e19342a7f4fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:58:3c,bridge_name='br-int',has_traffic_filtering=True,id=6b7287a0-44f1-4148-83ce-e19342a7f4fd,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7287a0-44') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG os_vif [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:58:3c,bridge_name='br-int',has_traffic_filtering=True,id=6b7287a0-44f1-4148-83ce-e19342a7f4fd,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7287a0-44') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b7287a0-44, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:23 user nova-compute[72000]: INFO os_vif [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:58:3c,bridge_name='br-int',has_traffic_filtering=True,id=6b7287a0-44f1-4148-83ce-e19342a7f4fd,network=Network(7ce99f7d-8859-4bc3-a102-1a170c3e1462),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7287a0-44')
Aug 16 18:09:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Deleting instance files /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2_del
Aug 16 18:09:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Deletion of /opt/stack/data/nova/instances/e6d1db4c-f1e7-4019-80c6-a9703ab18dc2_del complete
Aug 16 18:09:23 user nova-compute[72000]: INFO nova.compute.manager [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 16 18:09:23 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:09:23 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:09:23 user nova-compute[72000]: INFO nova.compute.manager [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Took 0.87 seconds to detach 1 volumes for instance.
Aug 16 18:09:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:24 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:09:24 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:09:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:24 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Deleted allocations for instance a8532341-62b3-4c58-b3d8-db5440ad08c3
Aug 16 18:09:24 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:24 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Took 0.65 seconds to deallocate network for instance.
Aug 16 18:09:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2df1c3a1-7a64-41df-a2d1-1d25d795b329 tempest-ServerActionsTestOtherB-915732487 tempest-ServerActionsTestOtherB-915732487-project-member] Lock "a8532341-62b3-4c58-b3d8-db5440ad08c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.594s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:24 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:09:24 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:09:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:24 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Deleted allocations for instance e6d1db4c-f1e7-4019-80c6-a9703ab18dc2
Aug 16 18:09:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bad77da6-2e99-44c3-9d37-8e1bfef22f2b tempest-ServersNegativeTestJSON-764876388 tempest-ServersNegativeTestJSON-764876388-project-member] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.829s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Received event network-vif-unplugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] Acquiring lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] No waiting events found dispatching network-vif-unplugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:25 user nova-compute[72000]: WARNING nova.compute.manager [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Received unexpected event network-vif-unplugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd for instance with vm_state deleted and task_state None.
Aug 16 18:09:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Received event network-vif-plugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] Acquiring lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] Lock "e6d1db4c-f1e7-4019-80c6-a9703ab18dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] No waiting events found dispatching network-vif-plugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:25 user nova-compute[72000]: WARNING nova.compute.manager [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Received unexpected event network-vif-plugged-6b7287a0-44f1-4148-83ce-e19342a7f4fd for instance with vm_state deleted and task_state None.
Aug 16 18:09:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-b96c18cb-c5eb-476f-84d6-15f29588cd3b req-d2adb890-14ca-4cc8-b4b5-5d6c49d50d6b service nova] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Received event network-vif-deleted-6b7287a0-44f1-4148-83ce-e19342a7f4fd {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:09:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:09:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:09:26 user nova-compute[72000]: INFO nova.compute.manager [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Took 8.02 seconds to detach 3 volumes for instance.
Aug 16 18:09:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:09:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:09:26 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:09:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:27 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Deleted allocations for instance d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7
Aug 16 18:09:27 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209352.1778512, d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:09:27 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] VM Stopped (Lifecycle Event)
Aug 16 18:09:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-deb56177-ade0-4152-b240-5ae82f528e86 None None] [instance: d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6e343e84-4564-4bb2-8c30-a67377ca5478 tempest-TaggedBootDevicesTest-1049065283 tempest-TaggedBootDevicesTest-1049065283-project-member] Lock "d6ce7e6f-6da4-4eeb-9fd7-5d0612ac71b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.870s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updating instance_info_cache with network_info: [{"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209353.4709089, f5fc020a-3be1-4e78-8825-89f06406e945 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:09:28 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] VM Stopped (Lifecycle Event)
Aug 16 18:09:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-28c75ead-a6d3-4bb8-aff8-5dc7a509ec25 None None] [instance: f5fc020a-3be1-4e78-8825-89f06406e945] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:09:29 user nova-compute[72000]: INFO nova.compute.claims [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Claim successful on node user
Aug 16 18:09:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:09:29 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:09:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.policy [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8955d5f063374ad18e8f055029e551c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a3d62962234183abd3a9e821f4df0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:09:30 user nova-compute[72000]: INFO nova.virt.block_device [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Booting with volume 7398e7e7-2dd3-4d02-b901-01279856260d at /dev/vda
Aug 16 18:09:30 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:09:30 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7964MB free_disk=23.969036102294922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG os_brick.utils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd1075d-24f4-4363-a56b-f6854b2bc277]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 1c23cfa1-85f3-4387-8d20-6ca528da4036 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b369c3d8-4d30-4936-aac1-9f0d758af1f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec6ae5c-d3d5-482c-976f-98e59a8634a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77abd4a-ffd2-4664-b4a9-2486f3c88d4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:09:30 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47d1db8-23be-46ce-b8bb-5f8d8ad5f5dc]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG os_brick.utils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Updating existing volume attachment record: 09b71b32-c013-4751-9503-2a6825e134a8 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:09:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Successfully created port: 5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Successfully updated port: 5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "refresh_cache-1c23cfa1-85f3-4387-8d20-6ca528da4036" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquired lock "refresh_cache-1c23cfa1-85f3-4387-8d20-6ca528da4036" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-4bf3e339-95ae-4f8c-bf71-a0110986315a req-cded7166-7c22-4fd2-88aa-8bc13b615eba service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-changed-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-4bf3e339-95ae-4f8c-bf71-a0110986315a req-cded7166-7c22-4fd2-88aa-8bc13b615eba service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Refreshing instance network info cache due to event network-changed-5b698323-edd3-4918-ac17-58e8f9c67ca5. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4bf3e339-95ae-4f8c-bf71-a0110986315a req-cded7166-7c22-4fd2-88aa-8bc13b615eba service nova] Acquiring lock "refresh_cache-1c23cfa1-85f3-4387-8d20-6ca528da4036" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Updating instance_info_cache with network_info: [{"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Releasing lock "refresh_cache-1c23cfa1-85f3-4387-8d20-6ca528da4036" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Instance network_info: |[{"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4bf3e339-95ae-4f8c-bf71-a0110986315a req-cded7166-7c22-4fd2-88aa-8bc13b615eba service nova] Acquired lock "refresh_cache-1c23cfa1-85f3-4387-8d20-6ca528da4036" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:09:32 user nova-compute[72000]: DEBUG nova.network.neutron [req-4bf3e339-95ae-4f8c-bf71-a0110986315a req-cded7166-7c22-4fd2-88aa-8bc13b615eba service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Refreshing network info cache for port 5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:09:33 user nova-compute[72000]: DEBUG nova.network.neutron [req-4bf3e339-95ae-4f8c-bf71-a0110986315a req-cded7166-7c22-4fd2-88aa-8bc13b615eba service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Updated VIF entry in instance network info cache for port 5b698323-edd3-4918-ac17-58e8f9c67ca5. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:09:33 user nova-compute[72000]: DEBUG nova.network.neutron [req-4bf3e339-95ae-4f8c-bf71-a0110986315a req-cded7166-7c22-4fd2-88aa-8bc13b615eba service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Updating instance_info_cache with network_info: [{"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4bf3e339-95ae-4f8c-bf71-a0110986315a req-cded7166-7c22-4fd2-88aa-8bc13b615eba service nova] Releasing lock "refresh_cache-1c23cfa1-85f3-4387-8d20-6ca528da4036" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:09:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:09:36 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209361.7022054, a8532341-62b3-4c58-b3d8-db5440ad08c3 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:09:36 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] VM Stopped (Lifecycle Event)
Aug 16 18:09:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-318945f0-03db-49d7-9984-4cc65aae939b None None] [instance: a8532341-62b3-4c58-b3d8-db5440ad08c3] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:09:38 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209363.663966, e6d1db4c-f1e7-4019-80c6-a9703ab18dc2 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:09:38 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] VM Stopped (Lifecycle Event)
Aug 16 18:09:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cf2c6511-018b-449c-8c40-c9b08871a24f None None] [instance: e6d1db4c-f1e7-4019-80c6-a9703ab18dc2] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:09:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:09:40 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Creating image(s)
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Ensure instance console log exists: /opt/stack/data/nova/instances/1c23cfa1-85f3-4387-8d20-6ca528da4036/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Start _get_guest_xml network_info=[{"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpEoGQmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c23cfa1-85f3-4387-8d20-6ca528da4036', 'attached_at': '', 'detached_at': '', 'volume_id': '7398e7e7-2dd3-4d02-b901-01279856260d', 'serial': '7398e7e7-2dd3-4d02-b901-01279856260d'}, 'attachment_id': '09b71b32-c013-4751-9503-2a6825e134a8', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:09:40 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:09:40 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpEoGQmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:09:40 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:09:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:09:40 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:09:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:09:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:09:40 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:09:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7d27e1-8dcd-4d83-bd88-9bf50827f699]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:09:41 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd80cbe-5de5-4c3c-b260-da5cc4582c1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d] added
Aug 16 18:09:41 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[762d8715-28f7-4040-8e83-eb1344c790de]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8603819-6b4c-4a0f-9c92-a6537c6efd2a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jpEoGQmy {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jpEoGQmy" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2104ab2d-63ae-40ea-8bbd-b0f15022dc89]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jpEoGQmy'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b280f-57e2-44ce-a419-a0fc8d40b1d5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a1d9c5-ccd3-489f-b39c-c9c840c78cea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:09:41 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:09:41 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:09:41 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 18:09:41 user nova-compute[72000]: 
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eea5e2-c05a-4246-8216-8780b46c20d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260]
Aug 16 18:09:41 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260] successful.
Aug 16 18:09:41 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6a0a47-0795-4007-baf2-5d9266f0e882]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ae7834-507d-4a48-a4e8-851f830628ae]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:09:41 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:09:41 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb5a837-cf02-4ecb-98bf-72665136e194]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:09:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpEoGQmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23533383366343134', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533383366343134', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-681785428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-681785428',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJlak2tOt9cBSjKnpDOfBeJRnXtSHC7w9mhcXjMleWm/v+NlNOnrvgK4h4DHZbJvfyMIQpiEmOMooTgiAJinHvhdGlplkZTUezGZ8m8aOqaEKOAfUdsDEee41ceWhBWEw==',key_name='tempest-keypair-372649896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a3d62962234183abd3a9e821f4df0f',ramdisk_id='',reservation_id='r-w9xfuhbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1522344658',owner_user_name='tempest-ServerActionsV293TestJSON-1522344658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8955d5f063374ad18e8f055029e551c3',uuid=1c23cfa1-85f3-4387-8d20-6ca528da4036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converting VIF {"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.objects.instance [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c23cfa1-85f3-4387-8d20-6ca528da4036 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:09:42 user nova-compute[72000]:   <uuid>1c23cfa1-85f3-4387-8d20-6ca528da4036</uuid>
Aug 16 18:09:42 user nova-compute[72000]:   <name>instance-00000015</name>
Aug 16 18:09:42 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:09:42 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:09:42 user nova-compute[72000]:   <metadata>
Aug 16 18:09:42 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:09:42 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:09:42 user nova-compute[72000]:       <nova:name>tempest-ServerActionsV293TestJSON-server-681785428</nova:name>
Aug 16 18:09:42 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:09:40</nova:creationTime>
Aug 16 18:09:42 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:09:42 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:09:42 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:09:42 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:09:42 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:09:42 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:09:42 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:09:42 user nova-compute[72000]:       <nova:owner>
Aug 16 18:09:42 user nova-compute[72000]:         <nova:user uuid="8955d5f063374ad18e8f055029e551c3">tempest-ServerActionsV293TestJSON-1522344658-project-member</nova:user>
Aug 16 18:09:42 user nova-compute[72000]:         <nova:project uuid="b0a3d62962234183abd3a9e821f4df0f">tempest-ServerActionsV293TestJSON-1522344658</nova:project>
Aug 16 18:09:42 user nova-compute[72000]:       </nova:owner>
Aug 16 18:09:42 user nova-compute[72000]:       <nova:ports>
Aug 16 18:09:42 user nova-compute[72000]:         <nova:port uuid="5b698323-edd3-4918-ac17-58e8f9c67ca5">
Aug 16 18:09:42 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:09:42 user nova-compute[72000]:         </nova:port>
Aug 16 18:09:42 user nova-compute[72000]:       </nova:ports>
Aug 16 18:09:42 user nova-compute[72000]:     </nova:instance>
Aug 16 18:09:42 user nova-compute[72000]:   </metadata>
Aug 16 18:09:42 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:09:42 user nova-compute[72000]:     <system>
Aug 16 18:09:42 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:09:42 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:09:42 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:09:42 user nova-compute[72000]:       <entry name="serial">1c23cfa1-85f3-4387-8d20-6ca528da4036</entry>
Aug 16 18:09:42 user nova-compute[72000]:       <entry name="uuid">1c23cfa1-85f3-4387-8d20-6ca528da4036</entry>
Aug 16 18:09:42 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:09:42 user nova-compute[72000]:     </system>
Aug 16 18:09:42 user nova-compute[72000]:   </sysinfo>
Aug 16 18:09:42 user nova-compute[72000]:   <os>
Aug 16 18:09:42 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:09:42 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:09:42 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:09:42 user nova-compute[72000]:   </os>
Aug 16 18:09:42 user nova-compute[72000]:   <features>
Aug 16 18:09:42 user nova-compute[72000]:     <acpi/>
Aug 16 18:09:42 user nova-compute[72000]:     <apic/>
Aug 16 18:09:42 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:09:42 user nova-compute[72000]:   </features>
Aug 16 18:09:42 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:09:42 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:09:42 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:09:42 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:09:42 user nova-compute[72000]:   </clock>
Aug 16 18:09:42 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:09:42 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:09:42 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:09:42 user nova-compute[72000]:   </cpu>
Aug 16 18:09:42 user nova-compute[72000]:   <devices>
Aug 16 18:09:42 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:09:42 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:09:42 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 18:09:42 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:09:42 user nova-compute[72000]:       <serial>7398e7e7-2dd3-4d02-b901-01279856260d</serial>
Aug 16 18:09:42 user nova-compute[72000]:     </disk>
Aug 16 18:09:42 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:09:42 user nova-compute[72000]:       <mac address="fa:16:3e:95:6f:01"/>
Aug 16 18:09:42 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:09:42 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:09:42 user nova-compute[72000]:       <target dev="tap5b698323-ed"/>
Aug 16 18:09:42 user nova-compute[72000]:     </interface>
Aug 16 18:09:42 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:09:42 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/1c23cfa1-85f3-4387-8d20-6ca528da4036/console.log" append="off"/>
Aug 16 18:09:42 user nova-compute[72000]:     </serial>
Aug 16 18:09:42 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:09:42 user nova-compute[72000]:     <video>
Aug 16 18:09:42 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:09:42 user nova-compute[72000]:     </video>
Aug 16 18:09:42 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:09:42 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:09:42 user nova-compute[72000]:     </rng>
Aug 16 18:09:42 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:09:42 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:09:42 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:09:42 user nova-compute[72000]:     </memballoon>
Aug 16 18:09:42 user nova-compute[72000]:   </devices>
Aug 16 18:09:42 user nova-compute[72000]: </domain>
Aug 16 18:09:42 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-681785428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-681785428',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJlak2tOt9cBSjKnpDOfBeJRnXtSHC7w9mhcXjMleWm/v+NlNOnrvgK4h4DHZbJvfyMIQpiEmOMooTgiAJinHvhdGlplkZTUezGZ8m8aOqaEKOAfUdsDEee41ceWhBWEw==',key_name='tempest-keypair-372649896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a3d62962234183abd3a9e821f4df0f',ramdisk_id='',reservation_id='r-w9xfuhbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1522344658',owner_user_name='tempest-ServerActionsV293TestJSON-1522344658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8955d5f063374ad18e8f055029e551c3',uuid=1c23cfa1-85f3-4387-8d20-6ca528da4036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converting VIF {"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG os_vif [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b698323-ed, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b698323-ed, col_values=(('external_ids', {'iface-id': '5b698323-edd3-4918-ac17-58e8f9c67ca5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:6f:01', 'vm-uuid': '1c23cfa1-85f3-4387-8d20-6ca528da4036'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:42 user nova-compute[72000]: INFO os_vif [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed')
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:09:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] No VIF found with MAC fa:16:3e:95:6f:01, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:09:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6964947-ec7d-4e18-b9db-24fc6704356b req-d87d545f-c2cf-42ff-96a8-176e7b43146c service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6964947-ec7d-4e18-b9db-24fc6704356b req-d87d545f-c2cf-42ff-96a8-176e7b43146c service nova] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6964947-ec7d-4e18-b9db-24fc6704356b req-d87d545f-c2cf-42ff-96a8-176e7b43146c service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f6964947-ec7d-4e18-b9db-24fc6704356b req-d87d545f-c2cf-42ff-96a8-176e7b43146c service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-f6964947-ec7d-4e18-b9db-24fc6704356b req-d87d545f-c2cf-42ff-96a8-176e7b43146c service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] No waiting events found dispatching network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:44 user nova-compute[72000]: WARNING nova.compute.manager [req-f6964947-ec7d-4e18-b9db-24fc6704356b req-d87d545f-c2cf-42ff-96a8-176e7b43146c service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received unexpected event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 for instance with vm_state building and task_state spawning.
Aug 16 18:09:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209385.9448118, 1c23cfa1-85f3-4387-8d20-6ca528da4036 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:09:45 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] VM Resumed (Lifecycle Event)
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:09:45 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Instance spawned successfully.
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:09:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:09:46 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:09:46 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209385.948457, 1c23cfa1-85f3-4387-8d20-6ca528da4036 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:09:46 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] VM Started (Lifecycle Event)
Aug 16 18:09:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:09:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:09:46 user nova-compute[72000]: INFO nova.compute.manager [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Took 5.14 seconds to spawn the instance on the hypervisor.
Aug 16 18:09:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:09:46 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:09:46 user nova-compute[72000]: INFO nova.compute.manager [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Took 17.11 seconds to build instance.
Aug 16 18:09:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-625cf5fc-8267-4106-b4bb-31309d4ce790 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.223s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:46 user nova-compute[72000]: DEBUG nova.compute.manager [req-6c76c057-cbc3-469f-9151-6716fb08198d req-fc0608ec-140c-4aeb-9655-5423787ccc04 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6c76c057-cbc3-469f-9151-6716fb08198d req-fc0608ec-140c-4aeb-9655-5423787ccc04 service nova] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6c76c057-cbc3-469f-9151-6716fb08198d req-fc0608ec-140c-4aeb-9655-5423787ccc04 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6c76c057-cbc3-469f-9151-6716fb08198d req-fc0608ec-140c-4aeb-9655-5423787ccc04 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:46 user nova-compute[72000]: DEBUG nova.compute.manager [req-6c76c057-cbc3-469f-9151-6716fb08198d req-fc0608ec-140c-4aeb-9655-5423787ccc04 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] No waiting events found dispatching network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:46 user nova-compute[72000]: WARNING nova.compute.manager [req-6c76c057-cbc3-469f-9151-6716fb08198d req-fc0608ec-140c-4aeb-9655-5423787ccc04 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received unexpected event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 for instance with vm_state active and task_state None.
Aug 16 18:09:46 user nova-compute[72000]: INFO nova.compute.manager [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Rescuing
Aug 16 18:09:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:09:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquired lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:09:46 user nova-compute[72000]: DEBUG nova.network.neutron [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG nova.network.neutron [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updating instance_info_cache with network_info: [{"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Releasing lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ef084cf-b0a8-4fef-a705-4fa21a30bd61 req-e65488d2-0aab-4e3e-a48e-a7aece348424 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ef084cf-b0a8-4fef-a705-4fa21a30bd61 req-e65488d2-0aab-4e3e-a48e-a7aece348424 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ef084cf-b0a8-4fef-a705-4fa21a30bd61 req-e65488d2-0aab-4e3e-a48e-a7aece348424 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ef084cf-b0a8-4fef-a705-4fa21a30bd61 req-e65488d2-0aab-4e3e-a48e-a7aece348424 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ef084cf-b0a8-4fef-a705-4fa21a30bd61 req-e65488d2-0aab-4e3e-a48e-a7aece348424 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:47 user nova-compute[72000]: WARNING nova.compute.manager [req-1ef084cf-b0a8-4fef-a705-4fa21a30bd61 req-e65488d2-0aab-4e3e-a48e-a7aece348424 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state active and task_state rescuing.
Aug 16 18:09:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:48 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Instance destroyed successfully.
Aug 16 18:09:48 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Attempting rescue
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Instance directory exists: not creating {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 18:09:48 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Creating image(s)
Aug 16 18:09:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.objects.instance [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.209s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue" returned: 0 in 0.060s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.objects.instance [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'migration_context' on Instance uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Start _get_guest_xml network_info=[{"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "vif_mac": "fa:16:3e:0b:57:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.objects.instance [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'resources' on Instance uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.objects.instance [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:48 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:09:48 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.objects.instance [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1571244693',display_name='tempest-ServerRescueNegativeTestJSON-server-1571244693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1571244693',id=16,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:05:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-pxsrqr84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:05:10Z,user_data=None,user_id='d07d329987884ac98b87374ca2074b86',uuid=4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "vif_mac": "fa:16:3e:0b:57:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "vif_mac": "fa:16:3e:0b:57:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=cb091dac-a7ef-4da6-a4c3-b0e1977f7350,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb091dac-a7') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.objects.instance [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:09:48 user nova-compute[72000]:   <uuid>4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716</uuid>
Aug 16 18:09:48 user nova-compute[72000]:   <name>instance-00000010</name>
Aug 16 18:09:48 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:09:48 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:09:48 user nova-compute[72000]:   <metadata>
Aug 16 18:09:48 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:09:48 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:09:48 user nova-compute[72000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1571244693</nova:name>
Aug 16 18:09:48 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:09:48</nova:creationTime>
Aug 16 18:09:48 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:09:48 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:09:48 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:09:48 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:09:48 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:09:48 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:09:48 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:09:48 user nova-compute[72000]:       <nova:owner>
Aug 16 18:09:48 user nova-compute[72000]:         <nova:user uuid="d07d329987884ac98b87374ca2074b86">tempest-ServerRescueNegativeTestJSON-1605720785-project-member</nova:user>
Aug 16 18:09:48 user nova-compute[72000]:         <nova:project uuid="5442ba2319584631a81b2d1208b5f65f">tempest-ServerRescueNegativeTestJSON-1605720785</nova:project>
Aug 16 18:09:48 user nova-compute[72000]:       </nova:owner>
Aug 16 18:09:48 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:09:48 user nova-compute[72000]:       <nova:ports>
Aug 16 18:09:48 user nova-compute[72000]:         <nova:port uuid="cb091dac-a7ef-4da6-a4c3-b0e1977f7350">
Aug 16 18:09:48 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:09:48 user nova-compute[72000]:         </nova:port>
Aug 16 18:09:48 user nova-compute[72000]:       </nova:ports>
Aug 16 18:09:48 user nova-compute[72000]:     </nova:instance>
Aug 16 18:09:48 user nova-compute[72000]:   </metadata>
Aug 16 18:09:48 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:09:48 user nova-compute[72000]:     <system>
Aug 16 18:09:48 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:09:48 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:09:48 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:09:48 user nova-compute[72000]:       <entry name="serial">4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716</entry>
Aug 16 18:09:48 user nova-compute[72000]:       <entry name="uuid">4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716</entry>
Aug 16 18:09:48 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:09:48 user nova-compute[72000]:     </system>
Aug 16 18:09:48 user nova-compute[72000]:   </sysinfo>
Aug 16 18:09:48 user nova-compute[72000]:   <os>
Aug 16 18:09:48 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:09:48 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:09:48 user nova-compute[72000]:   </os>
Aug 16 18:09:48 user nova-compute[72000]:   <features>
Aug 16 18:09:48 user nova-compute[72000]:     <acpi/>
Aug 16 18:09:48 user nova-compute[72000]:     <apic/>
Aug 16 18:09:48 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:09:48 user nova-compute[72000]:   </features>
Aug 16 18:09:48 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:09:48 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:09:48 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:09:48 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:09:48 user nova-compute[72000]:   </clock>
Aug 16 18:09:48 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:09:48 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:09:48 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:09:48 user nova-compute[72000]:   </cpu>
Aug 16 18:09:48 user nova-compute[72000]:   <devices>
Aug 16 18:09:48 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:09:48 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:09:48 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue"/>
Aug 16 18:09:48 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:09:48 user nova-compute[72000]:     </disk>
Aug 16 18:09:48 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:09:48 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:09:48 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk"/>
Aug 16 18:09:48 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:09:48 user nova-compute[72000]:     </disk>
Aug 16 18:09:48 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:09:48 user nova-compute[72000]:       <mac address="fa:16:3e:0b:57:ff"/>
Aug 16 18:09:48 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:09:48 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:09:48 user nova-compute[72000]:       <target dev="tapcb091dac-a7"/>
Aug 16 18:09:48 user nova-compute[72000]:     </interface>
Aug 16 18:09:48 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:09:48 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/console.log" append="off"/>
Aug 16 18:09:48 user nova-compute[72000]:     </serial>
Aug 16 18:09:48 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:09:48 user nova-compute[72000]:     <video>
Aug 16 18:09:48 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:09:48 user nova-compute[72000]:     </video>
Aug 16 18:09:48 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:09:48 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:09:48 user nova-compute[72000]:     </rng>
Aug 16 18:09:48 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:09:48 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:09:48 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:09:48 user nova-compute[72000]:     </memballoon>
Aug 16 18:09:48 user nova-compute[72000]:   </devices>
Aug 16 18:09:48 user nova-compute[72000]: </domain>
Aug 16 18:09:48 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:09:48 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Instance destroyed successfully.
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:09:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No VIF found with MAC fa:16:3e:0b:57:ff, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:09:49 user nova-compute[72000]: DEBUG nova.compute.manager [req-ff19d80a-d80e-45e2-be38-d307371cc1a4 req-96987376-2420-4807-979d-8e16567656fe service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ff19d80a-d80e-45e2-be38-d307371cc1a4 req-96987376-2420-4807-979d-8e16567656fe service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ff19d80a-d80e-45e2-be38-d307371cc1a4 req-96987376-2420-4807-979d-8e16567656fe service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ff19d80a-d80e-45e2-be38-d307371cc1a4 req-96987376-2420-4807-979d-8e16567656fe service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:49 user nova-compute[72000]: DEBUG nova.compute.manager [req-ff19d80a-d80e-45e2-be38-d307371cc1a4 req-96987376-2420-4807-979d-8e16567656fe service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:49 user nova-compute[72000]: WARNING nova.compute.manager [req-ff19d80a-d80e-45e2-be38-d307371cc1a4 req-96987376-2420-4807-979d-8e16567656fe service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state active and task_state rescuing.
Aug 16 18:09:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:51 user nova-compute[72000]: WARNING nova.compute.manager [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state active and task_state rescuing.
Aug 16 18:09:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:09:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:09:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:09:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:09:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:09:51 user nova-compute[72000]: WARNING nova.compute.manager [req-8f8b42b8-a0de-4ea8-8c10-7c4a38c87397 req-8c731409-b744-4ce0-bf1f-0eddc2f5ede3 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state active and task_state rescuing.
Aug 16 18:09:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:09:52 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209392.8233545, 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:09:52 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] VM Resumed (Lifecycle Event)
Aug 16 18:09:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-db5869cb-854f-43f6-ac70-f1182db8c425 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:09:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:09:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:09:52 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 18:09:52 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209392.8273127, 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:09:52 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] VM Started (Lifecycle Event)
Aug 16 18:09:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:09:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:09:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:09:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:08 user nova-compute[72000]: INFO nova.compute.manager [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Terminating instance
Aug 16 18:10:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-394f7307-6db0-40dc-9147-e22d326bcce1 req-38be8330-54a6-4e4a-a1a2-8ceed8ea1c7d service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-unplugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-394f7307-6db0-40dc-9147-e22d326bcce1 req-38be8330-54a6-4e4a-a1a2-8ceed8ea1c7d service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-394f7307-6db0-40dc-9147-e22d326bcce1 req-38be8330-54a6-4e4a-a1a2-8ceed8ea1c7d service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-394f7307-6db0-40dc-9147-e22d326bcce1 req-38be8330-54a6-4e4a-a1a2-8ceed8ea1c7d service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-394f7307-6db0-40dc-9147-e22d326bcce1 req-38be8330-54a6-4e4a-a1a2-8ceed8ea1c7d service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-unplugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-394f7307-6db0-40dc-9147-e22d326bcce1 req-38be8330-54a6-4e4a-a1a2-8ceed8ea1c7d service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-unplugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:10:08 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Instance destroyed successfully.
Aug 16 18:10:08 user nova-compute[72000]: DEBUG nova.objects.instance [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'resources' on Instance uuid f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1089625936',display_name='tempest-AttachVolumeTestJSON-server-1089625936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1089625936',id=5,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErb04qZpbsRut/09YXjqZYrtOHdBhP2tPvZwbKrovgBjHoU1dEbeqloQimLOszuW/qVazGtyEHJi8FlrHeWujg55/6v8atkLH5KmnvoByesgAKN67qz3UpqxjWpyoKkRQ==',key_name='tempest-keypair-622025030',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-gr5a7kt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "address": "fa:16:3e:e1:0f:ec", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac3c99f-65", "ovs_interfaceid": "2ac3c99f-65bd-4aaa-899d-41ec43d44906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG os_vif [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ac3c99f-65, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:10:08 user nova-compute[72000]: INFO os_vif [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0f:ec,bridge_name='br-int',has_traffic_filtering=True,id=2ac3c99f-65bd-4aaa-899d-41ec43d44906,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac3c99f-65')
Aug 16 18:10:08 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Deleting instance files /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c_del
Aug 16 18:10:08 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Deletion of /opt/stack/data/nova/instances/f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c_del complete
Aug 16 18:10:09 user nova-compute[72000]: INFO nova.compute.manager [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 16 18:10:09 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:10:09 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:10:09 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:10:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-15787af1-d8e0-4e5b-bbb7-9fd5370feec3 req-5f94b6ba-d7e2-46d6-a33b-4ef2e8c0daec service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-deleted-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:10 user nova-compute[72000]: INFO nova.compute.manager [req-15787af1-d8e0-4e5b-bbb7-9fd5370feec3 req-5f94b6ba-d7e2-46d6-a33b-4ef2e8c0daec service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Neutron deleted interface 2ac3c99f-65bd-4aaa-899d-41ec43d44906; detaching it from the instance and deleting it from the info cache
Aug 16 18:10:10 user nova-compute[72000]: DEBUG nova.network.neutron [req-15787af1-d8e0-4e5b-bbb7-9fd5370feec3 req-5f94b6ba-d7e2-46d6-a33b-4ef2e8c0daec service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-15787af1-d8e0-4e5b-bbb7-9fd5370feec3 req-5f94b6ba-d7e2-46d6-a33b-4ef2e8c0daec service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Detach interface failed, port_id=2ac3c99f-65bd-4aaa-899d-41ec43d44906, reason: Instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:10:10 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Took 1.40 seconds to deallocate network for instance.
Aug 16 18:10:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-644c5fac-dee8-4a1e-87fb-33ea96700dd8 req-a945e68b-4390-4b08-820e-7582731656da service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-644c5fac-dee8-4a1e-87fb-33ea96700dd8 req-a945e68b-4390-4b08-820e-7582731656da service nova] Acquiring lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-644c5fac-dee8-4a1e-87fb-33ea96700dd8 req-a945e68b-4390-4b08-820e-7582731656da service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-644c5fac-dee8-4a1e-87fb-33ea96700dd8 req-a945e68b-4390-4b08-820e-7582731656da service nova] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-644c5fac-dee8-4a1e-87fb-33ea96700dd8 req-a945e68b-4390-4b08-820e-7582731656da service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] No waiting events found dispatching network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:10:10 user nova-compute[72000]: WARNING nova.compute.manager [req-644c5fac-dee8-4a1e-87fb-33ea96700dd8 req-a945e68b-4390-4b08-820e-7582731656da service nova] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Received unexpected event network-vif-plugged-2ac3c99f-65bd-4aaa-899d-41ec43d44906 for instance with vm_state deleted and task_state None.
Aug 16 18:10:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:10 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Deleted allocations for instance f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c
Aug 16 18:10:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-32ef56ca-654f-419e-9b54-8742a7087c36 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.821s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:10:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:10:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:10:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:10:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:10:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:10:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:10:17 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:10:18 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updating instance_info_cache with network_info: [{"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:10:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:10:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:10:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:10:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:10:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:10:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:10:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:10:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:10:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:10:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:10:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:10:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209408.857087, f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:10:24 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] VM Stopped (Lifecycle Event)
Aug 16 18:10:24 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:10:24 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8002MB free_disk=23.98263168334961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1d57275d-8180-4002-bec9-2d2fa3098a9d None None] [instance: f4f3e6a4-d1bc-48e4-a035-40d3554f7b6c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 1c23cfa1-85f3-4387-8d20-6ca528da4036 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:10:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:25 user nova-compute[72000]: INFO nova.compute.manager [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Unshelving
Aug 16 18:10:25 user nova-compute[72000]: INFO nova.virt.block_device [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Booting with volume e617ca85-92ab-49a5-a034-6e9e1fe5f50d at /dev/vdc
Aug 16 18:10:25 user nova-compute[72000]: DEBUG os_brick.utils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcc76d7-0f5e-4680-a1f1-63338539638e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.037s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e677da-93cb-431f-89b3-18ce79e1a566]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b33219-8733-48f7-b57a-6df25cbf9832]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c7b262-39b9-4756-b867-b210e5b3e34c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:10:25 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:10:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[661c490e-63ef-4ca3-9981-ac49a562c1ea]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG os_brick.utils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:10:25 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updating existing volume attachment record: b9258128-0338-46a5-bb61-bf3b47a787c5 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:10:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:37 user nova-compute[72000]: DEBUG nova.objects.instance [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'pci_requests' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:37 user nova-compute[72000]: DEBUG nova.objects.instance [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'numa_topology' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:37 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:10:37 user nova-compute[72000]: INFO nova.compute.claims [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Claim successful on node user
Aug 16 18:10:37 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:10:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:10:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:37 user nova-compute[72000]: INFO nova.network.neutron [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updating port 570f94a4-3d2e-44e9-931f-147ee993a9e2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 18:10:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:10:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquired lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:10:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:10:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-6be8c266-ba20-4583-a461-77ad0d84276f req-d8181eeb-c5f7-4bee-b3d7-137696603e0e service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-changed-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-6be8c266-ba20-4583-a461-77ad0d84276f req-d8181eeb-c5f7-4bee-b3d7-137696603e0e service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Refreshing instance network info cache due to event network-changed-570f94a4-3d2e-44e9-931f-147ee993a9e2. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:10:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6be8c266-ba20-4583-a461-77ad0d84276f req-d8181eeb-c5f7-4bee-b3d7-137696603e0e service nova] Acquiring lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updating instance_info_cache with network_info: [{"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Releasing lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:10:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Creating image(s)
Aug 16 18:10:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "/opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "/opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "/opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6be8c266-ba20-4583-a461-77ad0d84276f req-d8181eeb-c5f7-4bee-b3d7-137696603e0e service nova] Acquired lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG nova.network.neutron [req-6be8c266-ba20-4583-a461-77ad0d84276f req-d8181eeb-c5f7-4bee-b3d7-137696603e0e service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Refreshing network info cache for port 570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "14b277e53ba1f3377f7c9da73e6d850357550e39" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "14b277e53ba1f3377f7c9da73e6d850357550e39" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39.part --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39.part --force-share --output=json" returned: 0 in 0.233s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:40 user nova-compute[72000]: DEBUG nova.virt.images [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] 7d69c5e5-b79e-48ac-9e60-2ff12ac2d4c2 was qcow2, converting to raw {{(pid=72000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 18:10:40 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:10:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39.part /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39.converted {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39.part /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39.converted" returned: 0 in 0.370s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39.converted --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "14b277e53ba1f3377f7c9da73e6d850357550e39" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.886s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-6be8c266-ba20-4583-a461-77ad0d84276f req-d8181eeb-c5f7-4bee-b3d7-137696603e0e service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updated VIF entry in instance network info cache for port 570f94a4-3d2e-44e9-931f-147ee993a9e2. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-6be8c266-ba20-4583-a461-77ad0d84276f req-d8181eeb-c5f7-4bee-b3d7-137696603e0e service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updating instance_info_cache with network_info: [{"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6be8c266-ba20-4583-a461-77ad0d84276f req-d8181eeb-c5f7-4bee-b3d7-137696603e0e service nova] Releasing lock "refresh_cache-35f9ef3c-4dd4-431b-997c-7c0f91d035cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39 --force-share --output=json" returned: 0 in 0.232s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "14b277e53ba1f3377f7c9da73e6d850357550e39" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "14b277e53ba1f3377f7c9da73e6d850357550e39" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39 --force-share --output=json" returned: 0 in 0.213s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39,backing_fmt=raw /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39,backing_fmt=raw /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk 1073741824" returned: 0 in 0.058s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "14b277e53ba1f3377f7c9da73e6d850357550e39" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39 --force-share --output=json" returned: 0 in 0.187s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:41 user nova-compute[72000]: DEBUG nova.objects.instance [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'migration_context' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:41 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Rebasing disk image.
Aug 16 18:10:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.221s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 -F raw /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 -F raw /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk" returned: 0 in 2.646s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Ensure instance console log exists: /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Start _get_guest_xml network_info=[{"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a440af53632e85f29f099d647fff7636',container_format='bare',created_at=2023-08-16T18:08:33Z,direct_url=<?>,disk_format='qcow2',id=7d69c5e5-b79e-48ac-9e60-2ff12ac2d4c2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2067903681-shelved',owner='c7b0883d8fa04d16ba310cd8ce6dbaa4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T18:08:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNqpEXHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '35f9ef3c-4dd4-431b-997c-7c0f91d035cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'e617ca85-92ab-49a5-a034-6e9e1fe5f50d', 'serial': 'e617ca85-92ab-49a5-a034-6e9e1fe5f50d'}, 'attachment_id': 'b9258128-0338-46a5-bb61-bf3b47a787c5', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:10:44 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:10:44 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a440af53632e85f29f099d647fff7636',container_format='bare',created_at=2023-08-16T18:08:33Z,direct_url=<?>,disk_format='qcow2',id=7d69c5e5-b79e-48ac-9e60-2ff12ac2d4c2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2067903681-shelved',owner='c7b0883d8fa04d16ba310cd8ce6dbaa4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T18:08:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.objects.instance [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNqpEXHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:10:44 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:10:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:10:44 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:10:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:10:44 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa00fe1a-7b28-415a-b6a1-2440a3c06fc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:10:44 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f4cb5e-d76c-4e44-850c-6f82727bd207]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d] added
Aug 16 18:10:44 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[29885d3f-7c48-4bf6-89e5-2ac89f30ec87]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd36b740-2617-46fc-95cc-0e40e37a1dce]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNqpEXHC {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MNqpEXHC" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21a9509-e281-4694-b371-c82ce730e965]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MNqpEXHC'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc5cc5d-5e75-4c61-a393-c9d8e6145977]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[296e2539-c549-4ae4-a83a-cc1f8bb91805]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:10:45 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:10:45 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aa71c1-7929-4756-a0f4-d1df7a1ddb79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d, portal: 172.16.0.220,3260]
Aug 16 18:10:45 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d, portal: 172.16.0.220,3260] successful.
Aug 16 18:10:45 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[393dd18c-9e3f-485f-aad2-f910cb970b56]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[034b5ecd-2e69-479a-88fc-ffcaf0b55e6a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:10:45 user nova-compute[72000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:10:45 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:10:45 user nova-compute[72000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:10:45 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[953f4394-5d3c-43c7-9666-cdf31d3623f7]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:10:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNqpEXHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23265363430643761', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265363430643761', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2067903681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2067903681',id=20,image_ref='7d69c5e5-b79e-48ac-9e60-2ff12ac2d4c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-627413116',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:06:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-zfoj5n1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member',shelved_at='2023-08-16T18:08:37.290427',shelved_host='user',shelved_image_id='7d69c5e5-b79e-48ac-9e60-2ff12ac2d4c2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=35f9ef3c-4dd4-431b-997c-7c0f91d035cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.objects.instance [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'pci_devices' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:10:46 user nova-compute[72000]:   <uuid>35f9ef3c-4dd4-431b-997c-7c0f91d035cd</uuid>
Aug 16 18:10:46 user nova-compute[72000]:   <name>instance-00000014</name>
Aug 16 18:10:46 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:10:46 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:10:46 user nova-compute[72000]:   <metadata>
Aug 16 18:10:46 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:10:46 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:10:46 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2067903681</nova:name>
Aug 16 18:10:46 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:10:44</nova:creationTime>
Aug 16 18:10:46 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:10:46 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:10:46 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:10:46 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:10:46 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:10:46 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:10:46 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:10:46 user nova-compute[72000]:       <nova:owner>
Aug 16 18:10:46 user nova-compute[72000]:         <nova:user uuid="135d5cc19e204a448036340be3ad519a">tempest-AttachVolumeShelveTestJSON-1660838105-project-member</nova:user>
Aug 16 18:10:46 user nova-compute[72000]:         <nova:project uuid="c7b0883d8fa04d16ba310cd8ce6dbaa4">tempest-AttachVolumeShelveTestJSON-1660838105</nova:project>
Aug 16 18:10:46 user nova-compute[72000]:       </nova:owner>
Aug 16 18:10:46 user nova-compute[72000]:       <nova:root type="image" uuid="7d69c5e5-b79e-48ac-9e60-2ff12ac2d4c2"/>
Aug 16 18:10:46 user nova-compute[72000]:       <nova:ports>
Aug 16 18:10:46 user nova-compute[72000]:         <nova:port uuid="570f94a4-3d2e-44e9-931f-147ee993a9e2">
Aug 16 18:10:46 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:10:46 user nova-compute[72000]:         </nova:port>
Aug 16 18:10:46 user nova-compute[72000]:       </nova:ports>
Aug 16 18:10:46 user nova-compute[72000]:     </nova:instance>
Aug 16 18:10:46 user nova-compute[72000]:   </metadata>
Aug 16 18:10:46 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:10:46 user nova-compute[72000]:     <system>
Aug 16 18:10:46 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:10:46 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:10:46 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:10:46 user nova-compute[72000]:       <entry name="serial">35f9ef3c-4dd4-431b-997c-7c0f91d035cd</entry>
Aug 16 18:10:46 user nova-compute[72000]:       <entry name="uuid">35f9ef3c-4dd4-431b-997c-7c0f91d035cd</entry>
Aug 16 18:10:46 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:10:46 user nova-compute[72000]:     </system>
Aug 16 18:10:46 user nova-compute[72000]:   </sysinfo>
Aug 16 18:10:46 user nova-compute[72000]:   <os>
Aug 16 18:10:46 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:10:46 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:10:46 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:10:46 user nova-compute[72000]:   </os>
Aug 16 18:10:46 user nova-compute[72000]:   <features>
Aug 16 18:10:46 user nova-compute[72000]:     <acpi/>
Aug 16 18:10:46 user nova-compute[72000]:     <apic/>
Aug 16 18:10:46 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:10:46 user nova-compute[72000]:   </features>
Aug 16 18:10:46 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:10:46 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:10:46 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:10:46 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:10:46 user nova-compute[72000]:   </clock>
Aug 16 18:10:46 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:10:46 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:10:46 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:10:46 user nova-compute[72000]:   </cpu>
Aug 16 18:10:46 user nova-compute[72000]:   <devices>
Aug 16 18:10:46 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:10:46 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:10:46 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk"/>
Aug 16 18:10:46 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:10:46 user nova-compute[72000]:     </disk>
Aug 16 18:10:46 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:10:46 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:10:46 user nova-compute[72000]:       <source dev="/dev/sdc"/>
Aug 16 18:10:46 user nova-compute[72000]:       <target dev="vdc" bus="virtio"/>
Aug 16 18:10:46 user nova-compute[72000]:       <serial>e617ca85-92ab-49a5-a034-6e9e1fe5f50d</serial>
Aug 16 18:10:46 user nova-compute[72000]:     </disk>
Aug 16 18:10:46 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:10:46 user nova-compute[72000]:       <mac address="fa:16:3e:95:83:32"/>
Aug 16 18:10:46 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:10:46 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:10:46 user nova-compute[72000]:       <target dev="tap570f94a4-3d"/>
Aug 16 18:10:46 user nova-compute[72000]:     </interface>
Aug 16 18:10:46 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:10:46 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/console.log" append="off"/>
Aug 16 18:10:46 user nova-compute[72000]:     </serial>
Aug 16 18:10:46 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:10:46 user nova-compute[72000]:     <video>
Aug 16 18:10:46 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:10:46 user nova-compute[72000]:     </video>
Aug 16 18:10:46 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:10:46 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:10:46 user nova-compute[72000]:     </rng>
Aug 16 18:10:46 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:10:46 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:10:46 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:10:46 user nova-compute[72000]:     </memballoon>
Aug 16 18:10:46 user nova-compute[72000]:   </devices>
Aug 16 18:10:46 user nova-compute[72000]: </domain>
Aug 16 18:10:46 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2067903681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2067903681',id=20,image_ref='7d69c5e5-b79e-48ac-9e60-2ff12ac2d4c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-627413116',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:06:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-zfoj5n1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member',shelved_at='2023-08-16T18:08:37.290427',shelved_host='user',shelved_image_id='7d69c5e5-b79e-48ac-9e60-2ff12ac2d4c2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=35f9ef3c-4dd4-431b-997c-7c0f91d035cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG os_vif [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap570f94a4-3d, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap570f94a4-3d, col_values=(('external_ids', {'iface-id': '570f94a4-3d2e-44e9-931f-147ee993a9e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:83:32', 'vm-uuid': '35f9ef3c-4dd4-431b-997c-7c0f91d035cd'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:46 user nova-compute[72000]: INFO os_vif [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d')
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:10:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] No VIF found with MAC fa:16:3e:95:83:32, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Acquiring lock "97b7a046-8dd5-4a68-9a60-470881815521" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "97b7a046-8dd5-4a68-9a60-470881815521" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:10:47 user nova-compute[72000]: INFO nova.compute.claims [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Claim successful on node user
Aug 16 18:10:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-6d284eb2-2088-485d-b9d6-bdf9e34dad30 req-56e40c89-d434-4247-8be3-c31f0e200772 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6d284eb2-2088-485d-b9d6-bdf9e34dad30 req-56e40c89-d434-4247-8be3-c31f0e200772 service nova] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6d284eb2-2088-485d-b9d6-bdf9e34dad30 req-56e40c89-d434-4247-8be3-c31f0e200772 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6d284eb2-2088-485d-b9d6-bdf9e34dad30 req-56e40c89-d434-4247-8be3-c31f0e200772 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-6d284eb2-2088-485d-b9d6-bdf9e34dad30 req-56e40c89-d434-4247-8be3-c31f0e200772 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] No waiting events found dispatching network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:10:47 user nova-compute[72000]: WARNING nova.compute.manager [req-6d284eb2-2088-485d-b9d6-bdf9e34dad30 req-56e40c89-d434-4247-8be3-c31f0e200772 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received unexpected event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 18:10:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.934s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:10:48 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:10:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:10:48 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Creating image(s)
Aug 16 18:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Acquiring lock "/opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "/opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "/opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG nova.policy [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29e08b38460543b6ac28f4ce93408125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17679e3b7c424f1db8881c1e33fb5db8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.214s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk 1073741824" returned: 0 in 0.056s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Successfully created port: 010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Cannot resize image /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG nova.objects.instance [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lazy-loading 'migration_context' on Instance uuid 97b7a046-8dd5-4a68-9a60-470881815521 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Ensure instance console log exists: /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG nova.compute.manager [req-4d9e062f-c9d9-4670-a124-032dbff271c5 req-66433e47-a9ec-47c5-a0ff-ec9a31cfcdf7 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4d9e062f-c9d9-4670-a124-032dbff271c5 req-66433e47-a9ec-47c5-a0ff-ec9a31cfcdf7 service nova] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4d9e062f-c9d9-4670-a124-032dbff271c5 req-66433e47-a9ec-47c5-a0ff-ec9a31cfcdf7 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4d9e062f-c9d9-4670-a124-032dbff271c5 req-66433e47-a9ec-47c5-a0ff-ec9a31cfcdf7 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:49 user nova-compute[72000]: DEBUG nova.compute.manager [req-4d9e062f-c9d9-4670-a124-032dbff271c5 req-66433e47-a9ec-47c5-a0ff-ec9a31cfcdf7 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] No waiting events found dispatching network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:10:49 user nova-compute[72000]: WARNING nova.compute.manager [req-4d9e062f-c9d9-4670-a124-032dbff271c5 req-66433e47-a9ec-47c5-a0ff-ec9a31cfcdf7 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received unexpected event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209450.2570412, 35f9ef3c-4dd4-431b-997c-7c0f91d035cd => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:10:50 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] VM Resumed (Lifecycle Event)
Aug 16 18:10:50 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Instance spawned successfully.
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:10:50 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209450.257211, 35f9ef3c-4dd4-431b-997c-7c0f91d035cd => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:10:50 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] VM Started (Lifecycle Event)
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:10:50 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Successfully updated port: 010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Acquiring lock "refresh_cache-97b7a046-8dd5-4a68-9a60-470881815521" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Acquired lock "refresh_cache-97b7a046-8dd5-4a68-9a60-470881815521" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-8309ec62-6081-42dd-8c1d-1e13385c0040 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.536s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Updating instance_info_cache with network_info: [{"id": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "address": "fa:16:3e:c4:40:c6", "network": {"id": "62a7a2f8-29e8-40cc-a8ca-4f434d51969e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6a9b1e19a41b48d58c2fc8559ff091a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010c7b3f-56", "ovs_interfaceid": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Releasing lock "refresh_cache-97b7a046-8dd5-4a68-9a60-470881815521" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Instance network_info: |[{"id": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "address": "fa:16:3e:c4:40:c6", "network": {"id": "62a7a2f8-29e8-40cc-a8ca-4f434d51969e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6a9b1e19a41b48d58c2fc8559ff091a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010c7b3f-56", "ovs_interfaceid": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Start _get_guest_xml network_info=[{"id": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "address": "fa:16:3e:c4:40:c6", "network": {"id": "62a7a2f8-29e8-40cc-a8ca-4f434d51969e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6a9b1e19a41b48d58c2fc8559ff091a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010c7b3f-56", "ovs_interfaceid": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:10:51 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:10:51 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2102083361',display_name='tempest-VolumesNegativeTest-instance-2102083361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2102083361',id=22,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17679e3b7c424f1db8881c1e33fb5db8',ramdisk_id='',reservation_id='r-xlkletvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1052736425',owner_user_name='tempest-VolumesNegativeTest-1052736425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:10:49Z,user_data=None,user_id='29e08b38460543b6ac28f4ce93408125',uuid=97b7a046-8dd5-4a68-9a60-470881815521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "address": "fa:16:3e:c4:40:c6", "network": {"id": "62a7a2f8-29e8-40cc-a8ca-4f434d51969e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6a9b1e19a41b48d58c2fc8559ff091a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010c7b3f-56", "ovs_interfaceid": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Converting VIF {"id": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "address": "fa:16:3e:c4:40:c6", "network": {"id": "62a7a2f8-29e8-40cc-a8ca-4f434d51969e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6a9b1e19a41b48d58c2fc8559ff091a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010c7b3f-56", "ovs_interfaceid": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=010c7b3f-560c-4f8b-825d-1274336bc8aa,network=Network(62a7a2f8-29e8-40cc-a8ca-4f434d51969e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010c7b3f-56') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.objects.instance [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lazy-loading 'pci_devices' on Instance uuid 97b7a046-8dd5-4a68-9a60-470881815521 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:10:51 user nova-compute[72000]:   <uuid>97b7a046-8dd5-4a68-9a60-470881815521</uuid>
Aug 16 18:10:51 user nova-compute[72000]:   <name>instance-00000016</name>
Aug 16 18:10:51 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:10:51 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:10:51 user nova-compute[72000]:   <metadata>
Aug 16 18:10:51 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:10:51 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:10:51 user nova-compute[72000]:       <nova:name>tempest-VolumesNegativeTest-instance-2102083361</nova:name>
Aug 16 18:10:51 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:10:51</nova:creationTime>
Aug 16 18:10:51 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:10:51 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:10:51 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:10:51 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:10:51 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:10:51 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:10:51 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:10:51 user nova-compute[72000]:       <nova:owner>
Aug 16 18:10:51 user nova-compute[72000]:         <nova:user uuid="29e08b38460543b6ac28f4ce93408125">tempest-VolumesNegativeTest-1052736425-project-member</nova:user>
Aug 16 18:10:51 user nova-compute[72000]:         <nova:project uuid="17679e3b7c424f1db8881c1e33fb5db8">tempest-VolumesNegativeTest-1052736425</nova:project>
Aug 16 18:10:51 user nova-compute[72000]:       </nova:owner>
Aug 16 18:10:51 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:10:51 user nova-compute[72000]:       <nova:ports>
Aug 16 18:10:51 user nova-compute[72000]:         <nova:port uuid="010c7b3f-560c-4f8b-825d-1274336bc8aa">
Aug 16 18:10:51 user nova-compute[72000]:           <nova:ip type="fixed" address="192.168.233.104" ipVersion="4"/>
Aug 16 18:10:51 user nova-compute[72000]:         </nova:port>
Aug 16 18:10:51 user nova-compute[72000]:       </nova:ports>
Aug 16 18:10:51 user nova-compute[72000]:     </nova:instance>
Aug 16 18:10:51 user nova-compute[72000]:   </metadata>
Aug 16 18:10:51 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:10:51 user nova-compute[72000]:     <system>
Aug 16 18:10:51 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:10:51 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:10:51 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:10:51 user nova-compute[72000]:       <entry name="serial">97b7a046-8dd5-4a68-9a60-470881815521</entry>
Aug 16 18:10:51 user nova-compute[72000]:       <entry name="uuid">97b7a046-8dd5-4a68-9a60-470881815521</entry>
Aug 16 18:10:51 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:10:51 user nova-compute[72000]:     </system>
Aug 16 18:10:51 user nova-compute[72000]:   </sysinfo>
Aug 16 18:10:51 user nova-compute[72000]:   <os>
Aug 16 18:10:51 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:10:51 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:10:51 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:10:51 user nova-compute[72000]:   </os>
Aug 16 18:10:51 user nova-compute[72000]:   <features>
Aug 16 18:10:51 user nova-compute[72000]:     <acpi/>
Aug 16 18:10:51 user nova-compute[72000]:     <apic/>
Aug 16 18:10:51 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:10:51 user nova-compute[72000]:   </features>
Aug 16 18:10:51 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:10:51 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:10:51 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:10:51 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:10:51 user nova-compute[72000]:   </clock>
Aug 16 18:10:51 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:10:51 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:10:51 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:10:51 user nova-compute[72000]:   </cpu>
Aug 16 18:10:51 user nova-compute[72000]:   <devices>
Aug 16 18:10:51 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:10:51 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:10:51 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk"/>
Aug 16 18:10:51 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:10:51 user nova-compute[72000]:     </disk>
Aug 16 18:10:51 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:10:51 user nova-compute[72000]:       <mac address="fa:16:3e:c4:40:c6"/>
Aug 16 18:10:51 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:10:51 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:10:51 user nova-compute[72000]:       <target dev="tap010c7b3f-56"/>
Aug 16 18:10:51 user nova-compute[72000]:     </interface>
Aug 16 18:10:51 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:10:51 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/console.log" append="off"/>
Aug 16 18:10:51 user nova-compute[72000]:     </serial>
Aug 16 18:10:51 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:10:51 user nova-compute[72000]:     <video>
Aug 16 18:10:51 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:10:51 user nova-compute[72000]:     </video>
Aug 16 18:10:51 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:10:51 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:10:51 user nova-compute[72000]:     </rng>
Aug 16 18:10:51 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:10:51 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:10:51 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:10:51 user nova-compute[72000]:     </memballoon>
Aug 16 18:10:51 user nova-compute[72000]:   </devices>
Aug 16 18:10:51 user nova-compute[72000]: </domain>
Aug 16 18:10:51 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2102083361',display_name='tempest-VolumesNegativeTest-instance-2102083361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2102083361',id=22,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17679e3b7c424f1db8881c1e33fb5db8',ramdisk_id='',reservation_id='r-xlkletvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1052736425',owner_user_name='tempest-VolumesNegativeTest-1052736425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:10:49Z,user_data=None,user_id='29e08b38460543b6ac28f4ce93408125',uuid=97b7a046-8dd5-4a68-9a60-470881815521,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "address": "fa:16:3e:c4:40:c6", "network": {"id": "62a7a2f8-29e8-40cc-a8ca-4f434d51969e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6a9b1e19a41b48d58c2fc8559ff091a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010c7b3f-56", "ovs_interfaceid": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Converting VIF {"id": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "address": "fa:16:3e:c4:40:c6", "network": {"id": "62a7a2f8-29e8-40cc-a8ca-4f434d51969e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6a9b1e19a41b48d58c2fc8559ff091a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010c7b3f-56", "ovs_interfaceid": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=010c7b3f-560c-4f8b-825d-1274336bc8aa,network=Network(62a7a2f8-29e8-40cc-a8ca-4f434d51969e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010c7b3f-56') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG os_vif [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=010c7b3f-560c-4f8b-825d-1274336bc8aa,network=Network(62a7a2f8-29e8-40cc-a8ca-4f434d51969e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010c7b3f-56') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap010c7b3f-56, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap010c7b3f-56, col_values=(('external_ids', {'iface-id': '010c7b3f-560c-4f8b-825d-1274336bc8aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:40:c6', 'vm-uuid': '97b7a046-8dd5-4a68-9a60-470881815521'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:51 user nova-compute[72000]: INFO os_vif [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=010c7b3f-560c-4f8b-825d-1274336bc8aa,network=Network(62a7a2f8-29e8-40cc-a8ca-4f434d51969e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010c7b3f-56')
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] No VIF found with MAC fa:16:3e:c4:40:c6, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:10:51 user nova-compute[72000]: INFO nova.compute.claims [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Claim successful on node user
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:10:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:10:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG nova.policy [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d52e6531f15469cb663a6dda51b53fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e27c5995794fe5bf7567c740f2570d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-27e8ffa2-8c31-4a93-b050-acdd308dc6f5 req-78f21425-f258-4d0a-8f72-2f422bc059d4 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Received event network-changed-010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-27e8ffa2-8c31-4a93-b050-acdd308dc6f5 req-78f21425-f258-4d0a-8f72-2f422bc059d4 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Refreshing instance network info cache due to event network-changed-010c7b3f-560c-4f8b-825d-1274336bc8aa. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-27e8ffa2-8c31-4a93-b050-acdd308dc6f5 req-78f21425-f258-4d0a-8f72-2f422bc059d4 service nova] Acquiring lock "refresh_cache-97b7a046-8dd5-4a68-9a60-470881815521" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-27e8ffa2-8c31-4a93-b050-acdd308dc6f5 req-78f21425-f258-4d0a-8f72-2f422bc059d4 service nova] Acquired lock "refresh_cache-97b7a046-8dd5-4a68-9a60-470881815521" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-27e8ffa2-8c31-4a93-b050-acdd308dc6f5 req-78f21425-f258-4d0a-8f72-2f422bc059d4 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Refreshing network info cache for port 010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:10:52 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Creating image(s)
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.214s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk 1073741824" returned: 0 in 0.045s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-27e8ffa2-8c31-4a93-b050-acdd308dc6f5 req-78f21425-f258-4d0a-8f72-2f422bc059d4 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Updated VIF entry in instance network info cache for port 010c7b3f-560c-4f8b-825d-1274336bc8aa. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-27e8ffa2-8c31-4a93-b050-acdd308dc6f5 req-78f21425-f258-4d0a-8f72-2f422bc059d4 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Updating instance_info_cache with network_info: [{"id": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "address": "fa:16:3e:c4:40:c6", "network": {"id": "62a7a2f8-29e8-40cc-a8ca-4f434d51969e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6a9b1e19a41b48d58c2fc8559ff091a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010c7b3f-56", "ovs_interfaceid": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-27e8ffa2-8c31-4a93-b050-acdd308dc6f5 req-78f21425-f258-4d0a-8f72-2f422bc059d4 service nova] Releasing lock "refresh_cache-97b7a046-8dd5-4a68-9a60-470881815521" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:10:52 user nova-compute[72000]: DEBUG nova.network.neutron [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Successfully created port: 52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-36952529-02d2-43b4-8f0a-64f41d0ec996 req-f933caf8-1d19-4dec-99df-99d8fbfcdb33 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Received event network-vif-plugged-010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36952529-02d2-43b4-8f0a-64f41d0ec996 req-f933caf8-1d19-4dec-99df-99d8fbfcdb33 service nova] Acquiring lock "97b7a046-8dd5-4a68-9a60-470881815521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36952529-02d2-43b4-8f0a-64f41d0ec996 req-f933caf8-1d19-4dec-99df-99d8fbfcdb33 service nova] Lock "97b7a046-8dd5-4a68-9a60-470881815521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36952529-02d2-43b4-8f0a-64f41d0ec996 req-f933caf8-1d19-4dec-99df-99d8fbfcdb33 service nova] Lock "97b7a046-8dd5-4a68-9a60-470881815521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-36952529-02d2-43b4-8f0a-64f41d0ec996 req-f933caf8-1d19-4dec-99df-99d8fbfcdb33 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] No waiting events found dispatching network-vif-plugged-010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:10:53 user nova-compute[72000]: WARNING nova.compute.manager [req-36952529-02d2-43b4-8f0a-64f41d0ec996 req-f933caf8-1d19-4dec-99df-99d8fbfcdb33 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Received unexpected event network-vif-plugged-010c7b3f-560c-4f8b-825d-1274336bc8aa for instance with vm_state building and task_state spawning.
Aug 16 18:10:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Cannot resize image /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'migration_context' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Ensure instance console log exists: /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG nova.network.neutron [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Successfully updated port: 52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquired lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG nova.network.neutron [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:10:53 user nova-compute[72000]: DEBUG nova.network.neutron [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [req-1c0098bf-ac73-4377-985a-39c8d3885068 req-daa1412d-db7f-4e80-817a-2217dd68d2a8 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-changed-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [req-1c0098bf-ac73-4377-985a-39c8d3885068 req-daa1412d-db7f-4e80-817a-2217dd68d2a8 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Refreshing instance network info cache due to event network-changed-52283d99-7220-49dd-92cd-8489ee426bc1. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1c0098bf-ac73-4377-985a-39c8d3885068 req-daa1412d-db7f-4e80-817a-2217dd68d2a8 service nova] Acquiring lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.network.neutron [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updating instance_info_cache with network_info: [{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Releasing lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Instance network_info: |[{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1c0098bf-ac73-4377-985a-39c8d3885068 req-daa1412d-db7f-4e80-817a-2217dd68d2a8 service nova] Acquired lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.network.neutron [req-1c0098bf-ac73-4377-985a-39c8d3885068 req-daa1412d-db7f-4e80-817a-2217dd68d2a8 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Refreshing network info cache for port 52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Start _get_guest_xml network_info=[{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:10:54 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:10:54 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2089464051',display_name='tempest-ServerStableDeviceRescueTest-server-2089464051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2089464051',id=23,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmWHm+7UdTQBS4QPyRtaW5DeIq9vhtWvX9ADUJEe3SmS2eKqAGYy5hZmyostFsGOQwmHmbgjvWY/LQB29YraeQXctLkJ0iVxnUHBvmf5NJW5jt7hxy6Ex17BeVwofI2yQ==',key_name='tempest-keypair-414040881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9e27c5995794fe5bf7567c740f2570d',ramdisk_id='',reservation_id='r-otkbq97w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1493393985',owner_user_name='tempest-ServerStableDeviceRescueTest-1493393985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d52e6531f15469cb663a6dda51b53fc',uuid=59b456c9-e5af-4e47-a2f1-ba4f35c8308a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Converting VIF {"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:5e:ea,bridge_name='br-int',has_traffic_filtering=True,id=52283d99-7220-49dd-92cd-8489ee426bc1,network=Network(16b11bd6-d226-449d-8035-04f4f3b3420a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52283d99-72') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'pci_devices' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:10:54 user nova-compute[72000]:   <uuid>59b456c9-e5af-4e47-a2f1-ba4f35c8308a</uuid>
Aug 16 18:10:54 user nova-compute[72000]:   <name>instance-00000017</name>
Aug 16 18:10:54 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:10:54 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:10:54 user nova-compute[72000]:   <metadata>
Aug 16 18:10:54 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:10:54 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:10:54 user nova-compute[72000]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2089464051</nova:name>
Aug 16 18:10:54 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:10:54</nova:creationTime>
Aug 16 18:10:54 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:10:54 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:10:54 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:10:54 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:10:54 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:10:54 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:10:54 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:10:54 user nova-compute[72000]:       <nova:owner>
Aug 16 18:10:54 user nova-compute[72000]:         <nova:user uuid="8d52e6531f15469cb663a6dda51b53fc">tempest-ServerStableDeviceRescueTest-1493393985-project-member</nova:user>
Aug 16 18:10:54 user nova-compute[72000]:         <nova:project uuid="a9e27c5995794fe5bf7567c740f2570d">tempest-ServerStableDeviceRescueTest-1493393985</nova:project>
Aug 16 18:10:54 user nova-compute[72000]:       </nova:owner>
Aug 16 18:10:54 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:10:54 user nova-compute[72000]:       <nova:ports>
Aug 16 18:10:54 user nova-compute[72000]:         <nova:port uuid="52283d99-7220-49dd-92cd-8489ee426bc1">
Aug 16 18:10:54 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 18:10:54 user nova-compute[72000]:         </nova:port>
Aug 16 18:10:54 user nova-compute[72000]:       </nova:ports>
Aug 16 18:10:54 user nova-compute[72000]:     </nova:instance>
Aug 16 18:10:54 user nova-compute[72000]:   </metadata>
Aug 16 18:10:54 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:10:54 user nova-compute[72000]:     <system>
Aug 16 18:10:54 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:10:54 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:10:54 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:10:54 user nova-compute[72000]:       <entry name="serial">59b456c9-e5af-4e47-a2f1-ba4f35c8308a</entry>
Aug 16 18:10:54 user nova-compute[72000]:       <entry name="uuid">59b456c9-e5af-4e47-a2f1-ba4f35c8308a</entry>
Aug 16 18:10:54 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:10:54 user nova-compute[72000]:     </system>
Aug 16 18:10:54 user nova-compute[72000]:   </sysinfo>
Aug 16 18:10:54 user nova-compute[72000]:   <os>
Aug 16 18:10:54 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:10:54 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:10:54 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:10:54 user nova-compute[72000]:   </os>
Aug 16 18:10:54 user nova-compute[72000]:   <features>
Aug 16 18:10:54 user nova-compute[72000]:     <acpi/>
Aug 16 18:10:54 user nova-compute[72000]:     <apic/>
Aug 16 18:10:54 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:10:54 user nova-compute[72000]:   </features>
Aug 16 18:10:54 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:10:54 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:10:54 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:10:54 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:10:54 user nova-compute[72000]:   </clock>
Aug 16 18:10:54 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:10:54 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:10:54 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:10:54 user nova-compute[72000]:   </cpu>
Aug 16 18:10:54 user nova-compute[72000]:   <devices>
Aug 16 18:10:54 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:10:54 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:10:54 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk"/>
Aug 16 18:10:54 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:10:54 user nova-compute[72000]:     </disk>
Aug 16 18:10:54 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:10:54 user nova-compute[72000]:       <mac address="fa:16:3e:02:5e:ea"/>
Aug 16 18:10:54 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:10:54 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:10:54 user nova-compute[72000]:       <target dev="tap52283d99-72"/>
Aug 16 18:10:54 user nova-compute[72000]:     </interface>
Aug 16 18:10:54 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:10:54 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/console.log" append="off"/>
Aug 16 18:10:54 user nova-compute[72000]:     </serial>
Aug 16 18:10:54 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:10:54 user nova-compute[72000]:     <video>
Aug 16 18:10:54 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:10:54 user nova-compute[72000]:     </video>
Aug 16 18:10:54 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:10:54 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:10:54 user nova-compute[72000]:     </rng>
Aug 16 18:10:54 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:10:54 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:10:54 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:10:54 user nova-compute[72000]:     </memballoon>
Aug 16 18:10:54 user nova-compute[72000]:   </devices>
Aug 16 18:10:54 user nova-compute[72000]: </domain>
Aug 16 18:10:54 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2089464051',display_name='tempest-ServerStableDeviceRescueTest-server-2089464051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2089464051',id=23,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmWHm+7UdTQBS4QPyRtaW5DeIq9vhtWvX9ADUJEe3SmS2eKqAGYy5hZmyostFsGOQwmHmbgjvWY/LQB29YraeQXctLkJ0iVxnUHBvmf5NJW5jt7hxy6Ex17BeVwofI2yQ==',key_name='tempest-keypair-414040881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9e27c5995794fe5bf7567c740f2570d',ramdisk_id='',reservation_id='r-otkbq97w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1493393985',owner_user_name='tempest-ServerStableDeviceRescueTest-1493393985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d52e6531f15469cb663a6dda51b53fc',uuid=59b456c9-e5af-4e47-a2f1-ba4f35c8308a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Converting VIF {"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:5e:ea,bridge_name='br-int',has_traffic_filtering=True,id=52283d99-7220-49dd-92cd-8489ee426bc1,network=Network(16b11bd6-d226-449d-8035-04f4f3b3420a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52283d99-72') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG os_vif [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:5e:ea,bridge_name='br-int',has_traffic_filtering=True,id=52283d99-7220-49dd-92cd-8489ee426bc1,network=Network(16b11bd6-d226-449d-8035-04f4f3b3420a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52283d99-72') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52283d99-72, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap52283d99-72, col_values=(('external_ids', {'iface-id': '52283d99-7220-49dd-92cd-8489ee426bc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:5e:ea', 'vm-uuid': '59b456c9-e5af-4e47-a2f1-ba4f35c8308a'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:54 user nova-compute[72000]: INFO os_vif [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:5e:ea,bridge_name='br-int',has_traffic_filtering=True,id=52283d99-7220-49dd-92cd-8489ee426bc1,network=Network(16b11bd6-d226-449d-8035-04f4f3b3420a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52283d99-72')
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] No VIF found with MAC fa:16:3e:02:5e:ea, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.network.neutron [req-1c0098bf-ac73-4377-985a-39c8d3885068 req-daa1412d-db7f-4e80-817a-2217dd68d2a8 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updated VIF entry in instance network info cache for port 52283d99-7220-49dd-92cd-8489ee426bc1. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG nova.network.neutron [req-1c0098bf-ac73-4377-985a-39c8d3885068 req-daa1412d-db7f-4e80-817a-2217dd68d2a8 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updating instance_info_cache with network_info: [{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:10:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1c0098bf-ac73-4377-985a-39c8d3885068 req-daa1412d-db7f-4e80-817a-2217dd68d2a8 service nova] Releasing lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-ce4a0f30-fd7e-48db-a6c9-cf91053a6403 req-c3c8d87d-c6b6-4700-82ac-dce6fb95d5ec service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Received event network-vif-plugged-010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ce4a0f30-fd7e-48db-a6c9-cf91053a6403 req-c3c8d87d-c6b6-4700-82ac-dce6fb95d5ec service nova] Acquiring lock "97b7a046-8dd5-4a68-9a60-470881815521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ce4a0f30-fd7e-48db-a6c9-cf91053a6403 req-c3c8d87d-c6b6-4700-82ac-dce6fb95d5ec service nova] Lock "97b7a046-8dd5-4a68-9a60-470881815521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ce4a0f30-fd7e-48db-a6c9-cf91053a6403 req-c3c8d87d-c6b6-4700-82ac-dce6fb95d5ec service nova] Lock "97b7a046-8dd5-4a68-9a60-470881815521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-ce4a0f30-fd7e-48db-a6c9-cf91053a6403 req-c3c8d87d-c6b6-4700-82ac-dce6fb95d5ec service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] No waiting events found dispatching network-vif-plugged-010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:10:55 user nova-compute[72000]: WARNING nova.compute.manager [req-ce4a0f30-fd7e-48db-a6c9-cf91053a6403 req-c3c8d87d-c6b6-4700-82ac-dce6fb95d5ec service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Received unexpected event network-vif-plugged-010c7b3f-560c-4f8b-825d-1274336bc8aa for instance with vm_state building and task_state spawning.
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209455.1619806, 97b7a046-8dd5-4a68-9a60-470881815521 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:10:55 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] VM Resumed (Lifecycle Event)
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:10:55 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Instance spawned successfully.
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:55 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209455.1645706, 97b7a046-8dd5-4a68-9a60-470881815521 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:10:55 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] VM Started (Lifecycle Event)
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:10:55 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:10:55 user nova-compute[72000]: INFO nova.compute.manager [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Took 6.44 seconds to spawn the instance on the hypervisor.
Aug 16 18:10:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:10:55 user nova-compute[72000]: INFO nova.compute.manager [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Took 7.73 seconds to build instance.
Aug 16 18:10:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1c419d66-3f7d-4653-b97b-b0f9638a2e50 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "97b7a046-8dd5-4a68-9a60-470881815521" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.871s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:56 user nova-compute[72000]: DEBUG nova.compute.manager [req-017480a1-a777-4803-855d-764bd2806466 req-664d9658-28c8-4cf4-ab77-0c19875912ab service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-017480a1-a777-4803-855d-764bd2806466 req-664d9658-28c8-4cf4-ab77-0c19875912ab service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-017480a1-a777-4803-855d-764bd2806466 req-664d9658-28c8-4cf4-ab77-0c19875912ab service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-017480a1-a777-4803-855d-764bd2806466 req-664d9658-28c8-4cf4-ab77-0c19875912ab service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:56 user nova-compute[72000]: DEBUG nova.compute.manager [req-017480a1-a777-4803-855d-764bd2806466 req-664d9658-28c8-4cf4-ab77-0c19875912ab service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:10:56 user nova-compute[72000]: WARNING nova.compute.manager [req-017480a1-a777-4803-855d-764bd2806466 req-664d9658-28c8-4cf4-ab77-0c19875912ab service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state building and task_state spawning.
Aug 16 18:10:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.compute.manager [req-304f6858-655e-4e27-9cca-8891a8e2b7c1 req-b657454e-4ec9-412f-8b9e-77c746ae0611 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-304f6858-655e-4e27-9cca-8891a8e2b7c1 req-b657454e-4ec9-412f-8b9e-77c746ae0611 service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-304f6858-655e-4e27-9cca-8891a8e2b7c1 req-b657454e-4ec9-412f-8b9e-77c746ae0611 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-304f6858-655e-4e27-9cca-8891a8e2b7c1 req-b657454e-4ec9-412f-8b9e-77c746ae0611 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.compute.manager [req-304f6858-655e-4e27-9cca-8891a8e2b7c1 req-b657454e-4ec9-412f-8b9e-77c746ae0611 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:10:58 user nova-compute[72000]: WARNING nova.compute.manager [req-304f6858-655e-4e27-9cca-8891a8e2b7c1 req-b657454e-4ec9-412f-8b9e-77c746ae0611 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state building and task_state spawning.
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209458.467084, 59b456c9-e5af-4e47-a2f1-ba4f35c8308a => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:10:58 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] VM Resumed (Lifecycle Event)
Aug 16 18:10:58 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Instance spawned successfully.
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:10:58 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209458.4751537, 59b456c9-e5af-4e47-a2f1-ba4f35c8308a => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:10:58 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] VM Started (Lifecycle Event)
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:10:58 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:10:58 user nova-compute[72000]: INFO nova.compute.manager [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Took 6.66 seconds to spawn the instance on the hypervisor.
Aug 16 18:10:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:10:58 user nova-compute[72000]: INFO nova.compute.manager [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Took 7.49 seconds to build instance.
Aug 16 18:10:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-57c6af1f-a190-416b-8955-bc74a8687882 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.629s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:10:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:11:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:11:04 user nova-compute[72000]: INFO nova.compute.claims [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Claim successful on node user
Aug 16 18:11:05 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:11:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:11:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG nova.policy [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6df288fb86024b8d8a10bb0d0049e499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcae1940950a4007898ba8d8ca6de402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:11:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Creating image(s)
Aug 16 18:11:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "/opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "/opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "/opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.260s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.216s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk 1073741824" returned: 0 in 0.059s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.193s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Successfully created port: c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Cannot resize image /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'migration_context' on Instance uuid edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Ensure instance console log exists: /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Successfully updated port: c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "refresh_cache-edc29b70-1de4-4824-a0f9-b7be23570630" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquired lock "refresh_cache-edc29b70-1de4-4824-a0f9-b7be23570630" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-99019084-4700-4b8d-98f0-0e871cc32bc5 req-ddb3ec30-a868-4cd4-be41-11a52e13bffb service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received event network-changed-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-99019084-4700-4b8d-98f0-0e871cc32bc5 req-ddb3ec30-a868-4cd4-be41-11a52e13bffb service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Refreshing instance network info cache due to event network-changed-c2b2f625-3095-4388-81e3-a180e303b684. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-99019084-4700-4b8d-98f0-0e871cc32bc5 req-ddb3ec30-a868-4cd4-be41-11a52e13bffb service nova] Acquiring lock "refresh_cache-edc29b70-1de4-4824-a0f9-b7be23570630" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Updating instance_info_cache with network_info: [{"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Releasing lock "refresh_cache-edc29b70-1de4-4824-a0f9-b7be23570630" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Instance network_info: |[{"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-99019084-4700-4b8d-98f0-0e871cc32bc5 req-ddb3ec30-a868-4cd4-be41-11a52e13bffb service nova] Acquired lock "refresh_cache-edc29b70-1de4-4824-a0f9-b7be23570630" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.network.neutron [req-99019084-4700-4b8d-98f0-0e871cc32bc5 req-ddb3ec30-a868-4cd4-be41-11a52e13bffb service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Refreshing network info cache for port c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Start _get_guest_xml network_info=[{"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:11:07 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:11:07 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:11:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1338479208',display_name='tempest-AttachVolumeTestJSON-server-1338479208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1338479208',id=24,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoFeRHIfNIO8xMvfYptvFjopkPBrgfX32MMTVhZgRm4o5gEn8mbwKBskk7KG8VZzmkGbl9rKQAcnqRkM//gfR1SZA80r1EwHpZYJxdtcaYd5iXJqNvTwDlG3U4Fp1cYNA==',key_name='tempest-keypair-1760269194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-q9imu0ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=edc29b70-1de4-4824-a0f9-b7be23570630,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:10:5f,bridge_name='br-int',has_traffic_filtering=True,id=c2b2f625-3095-4388-81e3-a180e303b684,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b2f625-30') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'pci_devices' on Instance uuid edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:11:07 user nova-compute[72000]:   <uuid>edc29b70-1de4-4824-a0f9-b7be23570630</uuid>
Aug 16 18:11:07 user nova-compute[72000]:   <name>instance-00000018</name>
Aug 16 18:11:07 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:11:07 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:11:07 user nova-compute[72000]:   <metadata>
Aug 16 18:11:07 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:11:07 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:11:07 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeTestJSON-server-1338479208</nova:name>
Aug 16 18:11:07 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:11:07</nova:creationTime>
Aug 16 18:11:07 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:11:07 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:11:07 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:11:07 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:11:07 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:11:07 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:11:07 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:11:07 user nova-compute[72000]:       <nova:owner>
Aug 16 18:11:07 user nova-compute[72000]:         <nova:user uuid="6df288fb86024b8d8a10bb0d0049e499">tempest-AttachVolumeTestJSON-120427729-project-member</nova:user>
Aug 16 18:11:07 user nova-compute[72000]:         <nova:project uuid="fcae1940950a4007898ba8d8ca6de402">tempest-AttachVolumeTestJSON-120427729</nova:project>
Aug 16 18:11:07 user nova-compute[72000]:       </nova:owner>
Aug 16 18:11:07 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:11:07 user nova-compute[72000]:       <nova:ports>
Aug 16 18:11:07 user nova-compute[72000]:         <nova:port uuid="c2b2f625-3095-4388-81e3-a180e303b684">
Aug 16 18:11:07 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 18:11:07 user nova-compute[72000]:         </nova:port>
Aug 16 18:11:07 user nova-compute[72000]:       </nova:ports>
Aug 16 18:11:07 user nova-compute[72000]:     </nova:instance>
Aug 16 18:11:07 user nova-compute[72000]:   </metadata>
Aug 16 18:11:07 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:11:07 user nova-compute[72000]:     <system>
Aug 16 18:11:07 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:11:07 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:11:07 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:11:07 user nova-compute[72000]:       <entry name="serial">edc29b70-1de4-4824-a0f9-b7be23570630</entry>
Aug 16 18:11:07 user nova-compute[72000]:       <entry name="uuid">edc29b70-1de4-4824-a0f9-b7be23570630</entry>
Aug 16 18:11:07 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:11:07 user nova-compute[72000]:     </system>
Aug 16 18:11:07 user nova-compute[72000]:   </sysinfo>
Aug 16 18:11:07 user nova-compute[72000]:   <os>
Aug 16 18:11:07 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:11:07 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:11:07 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:11:07 user nova-compute[72000]:   </os>
Aug 16 18:11:07 user nova-compute[72000]:   <features>
Aug 16 18:11:07 user nova-compute[72000]:     <acpi/>
Aug 16 18:11:07 user nova-compute[72000]:     <apic/>
Aug 16 18:11:07 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:11:07 user nova-compute[72000]:   </features>
Aug 16 18:11:07 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:11:07 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:11:07 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:11:07 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:11:07 user nova-compute[72000]:   </clock>
Aug 16 18:11:07 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:11:07 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:11:07 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:11:07 user nova-compute[72000]:   </cpu>
Aug 16 18:11:07 user nova-compute[72000]:   <devices>
Aug 16 18:11:07 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:11:07 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:11:07 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk"/>
Aug 16 18:11:07 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:11:07 user nova-compute[72000]:     </disk>
Aug 16 18:11:07 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:11:07 user nova-compute[72000]:       <mac address="fa:16:3e:48:10:5f"/>
Aug 16 18:11:07 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:11:07 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:11:07 user nova-compute[72000]:       <target dev="tapc2b2f625-30"/>
Aug 16 18:11:07 user nova-compute[72000]:     </interface>
Aug 16 18:11:07 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:11:07 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/console.log" append="off"/>
Aug 16 18:11:07 user nova-compute[72000]:     </serial>
Aug 16 18:11:07 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:11:07 user nova-compute[72000]:     <video>
Aug 16 18:11:07 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:11:07 user nova-compute[72000]:     </video>
Aug 16 18:11:07 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:11:07 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:11:07 user nova-compute[72000]:     </rng>
Aug 16 18:11:07 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:11:07 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:11:07 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:11:07 user nova-compute[72000]:     </memballoon>
Aug 16 18:11:07 user nova-compute[72000]:   </devices>
Aug 16 18:11:07 user nova-compute[72000]: </domain>
Aug 16 18:11:07 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:11:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1338479208',display_name='tempest-AttachVolumeTestJSON-server-1338479208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1338479208',id=24,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoFeRHIfNIO8xMvfYptvFjopkPBrgfX32MMTVhZgRm4o5gEn8mbwKBskk7KG8VZzmkGbl9rKQAcnqRkM//gfR1SZA80r1EwHpZYJxdtcaYd5iXJqNvTwDlG3U4Fp1cYNA==',key_name='tempest-keypair-1760269194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-q9imu0ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:11:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=edc29b70-1de4-4824-a0f9-b7be23570630,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:10:5f,bridge_name='br-int',has_traffic_filtering=True,id=c2b2f625-3095-4388-81e3-a180e303b684,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b2f625-30') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG os_vif [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:10:5f,bridge_name='br-int',has_traffic_filtering=True,id=c2b2f625-3095-4388-81e3-a180e303b684,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b2f625-30') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2b2f625-30, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2b2f625-30, col_values=(('external_ids', {'iface-id': 'c2b2f625-3095-4388-81e3-a180e303b684', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:10:5f', 'vm-uuid': 'edc29b70-1de4-4824-a0f9-b7be23570630'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:07 user nova-compute[72000]: INFO os_vif [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:10:5f,bridge_name='br-int',has_traffic_filtering=True,id=c2b2f625-3095-4388-81e3-a180e303b684,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b2f625-30')
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:11:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No VIF found with MAC fa:16:3e:48:10:5f, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:11:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-99019084-4700-4b8d-98f0-0e871cc32bc5 req-ddb3ec30-a868-4cd4-be41-11a52e13bffb service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Updated VIF entry in instance network info cache for port c2b2f625-3095-4388-81e3-a180e303b684. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:11:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-99019084-4700-4b8d-98f0-0e871cc32bc5 req-ddb3ec30-a868-4cd4-be41-11a52e13bffb service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Updating instance_info_cache with network_info: [{"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:11:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-99019084-4700-4b8d-98f0-0e871cc32bc5 req-ddb3ec30-a868-4cd4-be41-11a52e13bffb service nova] Releasing lock "refresh_cache-edc29b70-1de4-4824-a0f9-b7be23570630" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:11:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-c6e35dea-f0fa-4f4a-9eda-81919f8d7b2d req-4a33bb84-7248-412e-998b-9e4b7416b0df service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received event network-vif-plugged-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c6e35dea-f0fa-4f4a-9eda-81919f8d7b2d req-4a33bb84-7248-412e-998b-9e4b7416b0df service nova] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c6e35dea-f0fa-4f4a-9eda-81919f8d7b2d req-4a33bb84-7248-412e-998b-9e4b7416b0df service nova] Lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c6e35dea-f0fa-4f4a-9eda-81919f8d7b2d req-4a33bb84-7248-412e-998b-9e4b7416b0df service nova] Lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-c6e35dea-f0fa-4f4a-9eda-81919f8d7b2d req-4a33bb84-7248-412e-998b-9e4b7416b0df service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] No waiting events found dispatching network-vif-plugged-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:11:09 user nova-compute[72000]: WARNING nova.compute.manager [req-c6e35dea-f0fa-4f4a-9eda-81919f8d7b2d req-4a33bb84-7248-412e-998b-9e4b7416b0df service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received unexpected event network-vif-plugged-c2b2f625-3095-4388-81e3-a180e303b684 for instance with vm_state building and task_state spawning.
Aug 16 18:11:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209471.7685688, edc29b70-1de4-4824-a0f9-b7be23570630 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:11:11 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] VM Resumed (Lifecycle Event)
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:11:11 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Instance spawned successfully.
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:11:11 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209471.7819798, edc29b70-1de4-4824-a0f9-b7be23570630 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:11:11 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] VM Started (Lifecycle Event)
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:11:11 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:11:11 user nova-compute[72000]: INFO nova.compute.manager [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-32659ea0-c3aa-45e7-b674-581709171d5d req-b47cb75c-f783-4d3c-96a8-817e63822fce service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received event network-vif-plugged-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-32659ea0-c3aa-45e7-b674-581709171d5d req-b47cb75c-f783-4d3c-96a8-817e63822fce service nova] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-32659ea0-c3aa-45e7-b674-581709171d5d req-b47cb75c-f783-4d3c-96a8-817e63822fce service nova] Lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-32659ea0-c3aa-45e7-b674-581709171d5d req-b47cb75c-f783-4d3c-96a8-817e63822fce service nova] Lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-32659ea0-c3aa-45e7-b674-581709171d5d req-b47cb75c-f783-4d3c-96a8-817e63822fce service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] No waiting events found dispatching network-vif-plugged-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:11:11 user nova-compute[72000]: WARNING nova.compute.manager [req-32659ea0-c3aa-45e7-b674-581709171d5d req-b47cb75c-f783-4d3c-96a8-817e63822fce service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received unexpected event network-vif-plugged-c2b2f625-3095-4388-81e3-a180e303b684 for instance with vm_state building and task_state spawning.
Aug 16 18:11:12 user nova-compute[72000]: INFO nova.compute.manager [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Took 7.39 seconds to build instance.
Aug 16 18:11:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3f3704d9-cd40-48d6-adac-0b1f0b76a413 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.502s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:11:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:11:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:11:17 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:11:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:18 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Updating instance_info_cache with network_info: [{"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:11:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:11:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:11:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-53bdcf1f-fd8b-49c7-8585-942a44f69dc0 req-1bc6679e-d67e-42ab-ab2f-38d2ee689549 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-changed-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-53bdcf1f-fd8b-49c7-8585-942a44f69dc0 req-1bc6679e-d67e-42ab-ab2f-38d2ee689549 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Refreshing instance network info cache due to event network-changed-5b698323-edd3-4918-ac17-58e8f9c67ca5. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-53bdcf1f-fd8b-49c7-8585-942a44f69dc0 req-1bc6679e-d67e-42ab-ab2f-38d2ee689549 service nova] Acquiring lock "refresh_cache-1c23cfa1-85f3-4387-8d20-6ca528da4036" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-53bdcf1f-fd8b-49c7-8585-942a44f69dc0 req-1bc6679e-d67e-42ab-ab2f-38d2ee689549 service nova] Acquired lock "refresh_cache-1c23cfa1-85f3-4387-8d20-6ca528da4036" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG nova.network.neutron [req-53bdcf1f-fd8b-49c7-8585-942a44f69dc0 req-1bc6679e-d67e-42ab-ab2f-38d2ee689549 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Refreshing network info cache for port 5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG nova.network.neutron [req-53bdcf1f-fd8b-49c7-8585-942a44f69dc0 req-1bc6679e-d67e-42ab-ab2f-38d2ee689549 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Updated VIF entry in instance network info cache for port 5b698323-edd3-4918-ac17-58e8f9c67ca5. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG nova.network.neutron [req-53bdcf1f-fd8b-49c7-8585-942a44f69dc0 req-1bc6679e-d67e-42ab-ab2f-38d2ee689549 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Updating instance_info_cache with network_info: [{"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:11:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-53bdcf1f-fd8b-49c7-8585-942a44f69dc0 req-1bc6679e-d67e-42ab-ab2f-38d2ee689549 service nova] Releasing lock "refresh_cache-1c23cfa1-85f3-4387-8d20-6ca528da4036" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:11:21 user nova-compute[72000]: INFO nova.compute.manager [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Rebuilding instance
Aug 16 18:11:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1c23cfa1-85f3-4387-8d20-6ca528da4036 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lazy-loading 'pci_requests' on Instance uuid 1c23cfa1-85f3-4387-8d20-6ca528da4036 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c23cfa1-85f3-4387-8d20-6ca528da4036 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lazy-loading 'resources' on Instance uuid 1c23cfa1-85f3-4387-8d20-6ca528da4036 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lazy-loading 'migration_context' on Instance uuid 1c23cfa1-85f3-4387-8d20-6ca528da4036 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72000) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Instance destroyed successfully.
Aug 16 18:11:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Instance destroyed successfully.
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1372916711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-681785428',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJlak2tOt9cBSjKnpDOfBeJRnXtSHC7w9mhcXjMleWm/v+NlNOnrvgK4h4DHZbJvfyMIQpiEmOMooTgiAJinHvhdGlplkZTUezGZ8m8aOqaEKOAfUdsDEee41ceWhBWEw==',key_name='tempest-keypair-372649896',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0a3d62962234183abd3a9e821f4df0f',ramdisk_id='',reservation_id='r-w9xfuhbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1522344658',owner_user_name='tempest-ServerActionsV293TestJSON-1522344658-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8955d5f063374ad18e8f055029e551c3',uuid=1c23cfa1-85f3-4387-8d20-6ca528da4036,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converting VIF {"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_vif [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b698323-ed, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:11:22 user nova-compute[72000]: INFO os_vif [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed')
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpEoGQmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:11:22 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d1587f-d026-433a-829f-d94cf09cca5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fc2df3-0ebb-478e-9182-e07a2af0badb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:11:22 user nova-compute[72000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:11:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:11:22 user nova-compute[72000]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:11:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0102431c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-vif-unplugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] No waiting events found dispatching network-vif-unplugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:11:22 user nova-compute[72000]: WARNING nova.compute.manager [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received unexpected event network-vif-unplugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 for instance with vm_state active and task_state rebuilding.
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] No waiting events found dispatching network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:11:22 user nova-compute[72000]: WARNING nova.compute.manager [req-48cdbc88-849d-41d1-b642-774247e5684d req-f06c76c7-928e-4e33-9386-aaa88aabd1c2 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received unexpected event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 for instance with vm_state active and task_state rebuilding.
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a235f63a-3c37-48f7-a55f-63aaf77ace57]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fec35c1-3f5d-4085-a2a5-20dd4c7df6f3]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3b12d7-15a0-40a3-a137-8971c8e7cb42]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6240bc98-6f75-409b-84a8-533fd462a025]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7f0db804-5383f414f54633ce', '/dev/disk/by-id/scsi-23533383366343134', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7f0db804') {{(pid=83463) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[769b3265-53ac-4be0-b435-1bbd578dd3f3]: (4, None) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ade6767-03f5-4027-9726-34ab2c14411f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d0eb7e-47d6-42ea-bfa3-fd401c32a691]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260]
Aug 16 18:11:22 user nova-compute[72000]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260] successful.
Aug 16 18:11:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed60a925-a11d-43e0-8ca8-2deadbb1cbd6]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] <== disconnect_volume: return (331ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:11:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Deleting instance files /opt/stack/data/nova/instances/1c23cfa1-85f3-4387-8d20-6ca528da4036_del
Aug 16 18:11:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Deletion of /opt/stack/data/nova/instances/1c23cfa1-85f3-4387-8d20-6ca528da4036_del complete
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:11:22 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 1c23cfa1-85f3-4387-8d20-6ca528da4036 could not be found.
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpEoGQmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:11:22 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[224e6417-3304-4a29-b55e-4d785423b4f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b05fa6-684e-4b67-b9bf-537e8b3d9137]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:11:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:11:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0082c7250>, {}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Disconnecting from: [] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] <== disconnect_volume: return (64ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:11:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Preparing to wait for external event volume-reimaged-7398e7e7-2dd3-4d02-b901-01279856260d {{(pid=72000) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:11:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:11:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7501MB free_disk=23.886699676513672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 1c23cfa1-85f3-4387-8d20-6ca528da4036 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 97b7a046-8dd5-4a68-9a60-470881815521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance edc29b70-1de4-4824-a0f9-b7be23570630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:11:27 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:11:28 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:11:28 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:11:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:11:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.868s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:11:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:11:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:37 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209482.0509393, 1c23cfa1-85f3-4387-8d20-6ca528da4036 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:11:37 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] VM Stopped (Lifecycle Event)
Aug 16 18:11:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7d3afdcd-dad1-45ec-8cac-0e685a8e42a6 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:11:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:38 user nova-compute[72000]: INFO nova.compute.manager [None req-bf4587e1-0d7c-4b70-ad70-688c94d52345 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Unrescuing
Aug 16 18:11:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bf4587e1-0d7c-4b70-ad70-688c94d52345 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:11:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bf4587e1-0d7c-4b70-ad70-688c94d52345 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquired lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:11:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-bf4587e1-0d7c-4b70-ad70-688c94d52345 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:11:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-bf4587e1-0d7c-4b70-ad70-688c94d52345 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updating instance_info_cache with network_info: [{"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:11:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bf4587e1-0d7c-4b70-ad70-688c94d52345 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Releasing lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:11:38 user nova-compute[72000]: DEBUG nova.objects.instance [None req-bf4587e1-0d7c-4b70-ad70-688c94d52345 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'flavor' on Instance uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:11:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-1e27a038-88ee-4997-90fc-861151bb018b req-22a31527-e6e0-4ce0-8af6-cac1c64a2e6c service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1e27a038-88ee-4997-90fc-861151bb018b req-22a31527-e6e0-4ce0-8af6-cac1c64a2e6c service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1e27a038-88ee-4997-90fc-861151bb018b req-22a31527-e6e0-4ce0-8af6-cac1c64a2e6c service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1e27a038-88ee-4997-90fc-861151bb018b req-22a31527-e6e0-4ce0-8af6-cac1c64a2e6c service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-1e27a038-88ee-4997-90fc-861151bb018b req-22a31527-e6e0-4ce0-8af6-cac1c64a2e6c service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:11:39 user nova-compute[72000]: WARNING nova.compute.manager [req-1e27a038-88ee-4997-90fc-861151bb018b req-22a31527-e6e0-4ce0-8af6-cac1c64a2e6c service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:11:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Instance destroyed successfully.
Aug 16 18:11:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:11:41 user nova-compute[72000]: WARNING nova.compute.manager [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:11:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:11:41 user nova-compute[72000]: WARNING nova.compute.manager [req-8b660017-3dff-4adf-8f67-40221034a0f7 req-9cabd90a-e4c6-4ee7-9b87-70d77e7e5035 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:11:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-c9e6f2e9-64b2-4bfb-94c9-3c00bb9219cc req-30d0889f-8afc-4ef0-918f-ab28aff8ab60 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c9e6f2e9-64b2-4bfb-94c9-3c00bb9219cc req-30d0889f-8afc-4ef0-918f-ab28aff8ab60 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c9e6f2e9-64b2-4bfb-94c9-3c00bb9219cc req-30d0889f-8afc-4ef0-918f-ab28aff8ab60 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c9e6f2e9-64b2-4bfb-94c9-3c00bb9219cc req-30d0889f-8afc-4ef0-918f-ab28aff8ab60 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-c9e6f2e9-64b2-4bfb-94c9-3c00bb9219cc req-30d0889f-8afc-4ef0-918f-ab28aff8ab60 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:11:43 user nova-compute[72000]: WARNING nova.compute.manager [req-c9e6f2e9-64b2-4bfb-94c9-3c00bb9219cc req-30d0889f-8afc-4ef0-918f-ab28aff8ab60 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:11:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:11:43 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209503.6802616, 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:11:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] VM Resumed (Lifecycle Event)
Aug 16 18:11:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-bf4587e1-0d7c-4b70-ad70-688c94d52345 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:11:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:11:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:11:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 18:11:43 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209503.6816256, 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:11:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] VM Started (Lifecycle Event)
Aug 16 18:11:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:11:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:11:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 18:11:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-c5f745c3-7a0e-418a-bedb-8201e479c016 req-58baa452-0d45-4274-93f0-3381f5ccce23 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event volume-reimaged-7398e7e7-2dd3-4d02-b901-01279856260d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c5f745c3-7a0e-418a-bedb-8201e479c016 req-58baa452-0d45-4274-93f0-3381f5ccce23 service nova] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c5f745c3-7a0e-418a-bedb-8201e479c016 req-58baa452-0d45-4274-93f0-3381f5ccce23 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c5f745c3-7a0e-418a-bedb-8201e479c016 req-58baa452-0d45-4274-93f0-3381f5ccce23 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-c5f745c3-7a0e-418a-bedb-8201e479c016 req-58baa452-0d45-4274-93f0-3381f5ccce23 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Processing event volume-reimaged-7398e7e7-2dd3-4d02-b901-01279856260d {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:11:45 user nova-compute[72000]: INFO nova.virt.block_device [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Booting with volume 7398e7e7-2dd3-4d02-b901-01279856260d at /dev/vda
Aug 16 18:11:45 user nova-compute[72000]: DEBUG os_brick.utils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b713383f-c3b5-4afc-b645-a4f91da6c435]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[db871fd8-c4a7-40c0-b48c-f343d1dc039e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaa4fed-88e4-4615-8c35-0eac18b740e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[769da211-3642-4f59-afc1-722cdfa24495]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:11:45 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:11:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1400111-d4d4-41e1-afba-b21cfbeffeed]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG os_brick.utils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:11:45 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Updating existing volume attachment record: 7063950f-f62a-4c9b-8dce-8cacb58fb115 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:11:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:11:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:11:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:11:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:11:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:11:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:11:57 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Creating image(s)
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Ensure instance console log exists: /opt/stack/data/nova/instances/1c23cfa1-85f3-4387-8d20-6ca528da4036/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Start _get_guest_xml network_info=[{"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpEoGQmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c23cfa1-85f3-4387-8d20-6ca528da4036', 'attached_at': '', 'detached_at': '', 'volume_id': '7398e7e7-2dd3-4d02-b901-01279856260d', 'serial': '7398e7e7-2dd3-4d02-b901-01279856260d'}, 'attachment_id': '7063950f-f62a-4c9b-8dce-8cacb58fb115', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:11:57 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 18:11:57 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1c23cfa1-85f3-4387-8d20-6ca528da4036 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpEoGQmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:11:57 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:11:57 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:11:57 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d256404-9b6c-45be-ae82-bb1ce8086a22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:11:57 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e223be20-80e4-4bfa-9556-d27d1226bde8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d] added
Aug 16 18:11:57 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8730bf-f7c8-419f-942b-fac4b85bc4e5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3bcb08-98df-41eb-ac71-21b7c4f1a701]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jpEoGQmy {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jpEoGQmy" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90b812e-fdad-484c-81c1-9a0c6108df45]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jpEoGQmy'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f149bad4-1fdd-49fe-982e-e730c0db971b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c6d4c-0204-4be5-b9fb-1d818598da8f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:11:57 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:11:57 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4a0351-2b13-4aac-95e3-6cfca86bdc37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260]
Aug 16 18:11:57 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260] successful.
Aug 16 18:11:57 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[199b0f7c-a2f3-411d-8cc8-474500fcc339]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e8496-0788-4864-af12-f41a07f9ef19]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:11:57 user nova-compute[72000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:11:57 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:11:57 user nova-compute[72000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:11:57 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde2a23b-5603-46d7-a0b2-719800414f04]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:11:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpEoGQmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23533383366343134', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533383366343134', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1372916711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-681785428',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJlak2tOt9cBSjKnpDOfBeJRnXtSHC7w9mhcXjMleWm/v+NlNOnrvgK4h4DHZbJvfyMIQpiEmOMooTgiAJinHvhdGlplkZTUezGZ8m8aOqaEKOAfUdsDEee41ceWhBWEw==',key_name='tempest-keypair-372649896',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0a3d62962234183abd3a9e821f4df0f',ramdisk_id='',reservation_id='r-w9xfuhbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1522344658',owner_user_name='tempest-ServerActionsV293TestJSON-1522344658-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8955d5f063374ad18e8f055029e551c3',uuid=1c23cfa1-85f3-4387-8d20-6ca528da4036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converting VIF {"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:11:58 user nova-compute[72000]:   <uuid>1c23cfa1-85f3-4387-8d20-6ca528da4036</uuid>
Aug 16 18:11:58 user nova-compute[72000]:   <name>instance-00000015</name>
Aug 16 18:11:58 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:11:58 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:11:58 user nova-compute[72000]:   <metadata>
Aug 16 18:11:58 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:11:58 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:11:58 user nova-compute[72000]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1372916711</nova:name>
Aug 16 18:11:58 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:11:57</nova:creationTime>
Aug 16 18:11:58 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:11:58 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:11:58 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:11:58 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:11:58 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:11:58 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:11:58 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:11:58 user nova-compute[72000]:       <nova:owner>
Aug 16 18:11:58 user nova-compute[72000]:         <nova:user uuid="8955d5f063374ad18e8f055029e551c3">tempest-ServerActionsV293TestJSON-1522344658-project-member</nova:user>
Aug 16 18:11:58 user nova-compute[72000]:         <nova:project uuid="b0a3d62962234183abd3a9e821f4df0f">tempest-ServerActionsV293TestJSON-1522344658</nova:project>
Aug 16 18:11:58 user nova-compute[72000]:       </nova:owner>
Aug 16 18:11:58 user nova-compute[72000]:       <nova:ports>
Aug 16 18:11:58 user nova-compute[72000]:         <nova:port uuid="5b698323-edd3-4918-ac17-58e8f9c67ca5">
Aug 16 18:11:58 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:11:58 user nova-compute[72000]:         </nova:port>
Aug 16 18:11:58 user nova-compute[72000]:       </nova:ports>
Aug 16 18:11:58 user nova-compute[72000]:     </nova:instance>
Aug 16 18:11:58 user nova-compute[72000]:   </metadata>
Aug 16 18:11:58 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:11:58 user nova-compute[72000]:     <system>
Aug 16 18:11:58 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:11:58 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:11:58 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:11:58 user nova-compute[72000]:       <entry name="serial">1c23cfa1-85f3-4387-8d20-6ca528da4036</entry>
Aug 16 18:11:58 user nova-compute[72000]:       <entry name="uuid">1c23cfa1-85f3-4387-8d20-6ca528da4036</entry>
Aug 16 18:11:58 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:11:58 user nova-compute[72000]:     </system>
Aug 16 18:11:58 user nova-compute[72000]:   </sysinfo>
Aug 16 18:11:58 user nova-compute[72000]:   <os>
Aug 16 18:11:58 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:11:58 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:11:58 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:11:58 user nova-compute[72000]:   </os>
Aug 16 18:11:58 user nova-compute[72000]:   <features>
Aug 16 18:11:58 user nova-compute[72000]:     <acpi/>
Aug 16 18:11:58 user nova-compute[72000]:     <apic/>
Aug 16 18:11:58 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:11:58 user nova-compute[72000]:   </features>
Aug 16 18:11:58 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:11:58 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:11:58 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:11:58 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:11:58 user nova-compute[72000]:   </clock>
Aug 16 18:11:58 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:11:58 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:11:58 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:11:58 user nova-compute[72000]:   </cpu>
Aug 16 18:11:58 user nova-compute[72000]:   <devices>
Aug 16 18:11:58 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:11:58 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:11:58 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 18:11:58 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:11:58 user nova-compute[72000]:       <serial>7398e7e7-2dd3-4d02-b901-01279856260d</serial>
Aug 16 18:11:58 user nova-compute[72000]:     </disk>
Aug 16 18:11:58 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:11:58 user nova-compute[72000]:       <mac address="fa:16:3e:95:6f:01"/>
Aug 16 18:11:58 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:11:58 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:11:58 user nova-compute[72000]:       <target dev="tap5b698323-ed"/>
Aug 16 18:11:58 user nova-compute[72000]:     </interface>
Aug 16 18:11:58 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:11:58 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/1c23cfa1-85f3-4387-8d20-6ca528da4036/console.log" append="off"/>
Aug 16 18:11:58 user nova-compute[72000]:     </serial>
Aug 16 18:11:58 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:11:58 user nova-compute[72000]:     <video>
Aug 16 18:11:58 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:11:58 user nova-compute[72000]:     </video>
Aug 16 18:11:58 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:11:58 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:11:58 user nova-compute[72000]:     </rng>
Aug 16 18:11:58 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:11:58 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:11:58 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:11:58 user nova-compute[72000]:     </memballoon>
Aug 16 18:11:58 user nova-compute[72000]:   </devices>
Aug 16 18:11:58 user nova-compute[72000]: </domain>
Aug 16 18:11:58 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1372916711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-681785428',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJlak2tOt9cBSjKnpDOfBeJRnXtSHC7w9mhcXjMleWm/v+NlNOnrvgK4h4DHZbJvfyMIQpiEmOMooTgiAJinHvhdGlplkZTUezGZ8m8aOqaEKOAfUdsDEee41ceWhBWEw==',key_name='tempest-keypair-372649896',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0a3d62962234183abd3a9e821f4df0f',ramdisk_id='',reservation_id='r-w9xfuhbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1522344658',owner_user_name='tempest-ServerActionsV293TestJSON-1522344658-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8955d5f063374ad18e8f055029e551c3',uuid=1c23cfa1-85f3-4387-8d20-6ca528da4036,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converting VIF {"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG os_vif [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b698323-ed, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b698323-ed, col_values=(('external_ids', {'iface-id': '5b698323-edd3-4918-ac17-58e8f9c67ca5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:6f:01', 'vm-uuid': '1c23cfa1-85f3-4387-8d20-6ca528da4036'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:58 user nova-compute[72000]: INFO os_vif [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed')
Aug 16 18:11:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:11:58 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] No VIF found with MAC fa:16:3e:95:6f:01, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:11:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:11:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:00 user nova-compute[72000]: DEBUG nova.compute.manager [req-95a9490f-be51-42f5-8aaa-40c295d3c76b req-007a0516-bb40-4a2a-8f9a-322d1e29670b service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:12:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-95a9490f-be51-42f5-8aaa-40c295d3c76b req-007a0516-bb40-4a2a-8f9a-322d1e29670b service nova] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-95a9490f-be51-42f5-8aaa-40c295d3c76b req-007a0516-bb40-4a2a-8f9a-322d1e29670b service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-95a9490f-be51-42f5-8aaa-40c295d3c76b req-007a0516-bb40-4a2a-8f9a-322d1e29670b service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:00 user nova-compute[72000]: DEBUG nova.compute.manager [req-95a9490f-be51-42f5-8aaa-40c295d3c76b req-007a0516-bb40-4a2a-8f9a-322d1e29670b service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] No waiting events found dispatching network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:12:00 user nova-compute[72000]: WARNING nova.compute.manager [req-95a9490f-be51-42f5-8aaa-40c295d3c76b req-007a0516-bb40-4a2a-8f9a-322d1e29670b service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received unexpected event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 18:12:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209522.093449, 1c23cfa1-85f3-4387-8d20-6ca528da4036 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:12:02 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] VM Resumed (Lifecycle Event)
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:12:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Instance spawned successfully.
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:02 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209522.096953, 1c23cfa1-85f3-4387-8d20-6ca528da4036 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:12:02 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] VM Started (Lifecycle Event)
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:12:02 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-a856c8ca-48c0-4965-814a-15b2cd88bbda req-153dd790-40be-4228-8dc4-53cc11bcf798 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a856c8ca-48c0-4965-814a-15b2cd88bbda req-153dd790-40be-4228-8dc4-53cc11bcf798 service nova] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a856c8ca-48c0-4965-814a-15b2cd88bbda req-153dd790-40be-4228-8dc4-53cc11bcf798 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a856c8ca-48c0-4965-814a-15b2cd88bbda req-153dd790-40be-4228-8dc4-53cc11bcf798 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-a856c8ca-48c0-4965-814a-15b2cd88bbda req-153dd790-40be-4228-8dc4-53cc11bcf798 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] No waiting events found dispatching network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:12:02 user nova-compute[72000]: WARNING nova.compute.manager [req-a856c8ca-48c0-4965-814a-15b2cd88bbda req-153dd790-40be-4228-8dc4-53cc11bcf798 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received unexpected event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 for instance with vm_state active and task_state rebuild_spawning.
Aug 16 18:12:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72000) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 16 18:12:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c5f745c3-7a0e-418a-bedb-8201e479c016 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:16 user nova-compute[72000]: INFO nova.compute.manager [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Detaching volume e617ca85-92ab-49a5-a034-6e9e1fe5f50d
Aug 16 18:12:16 user nova-compute[72000]: INFO nova.virt.block_device [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Attempting to driver detach volume e617ca85-92ab-49a5-a034-6e9e1fe5f50d from mountpoint /dev/vdc
Aug 16 18:12:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Attempting to detach device vdc from instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:12:16 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:12:16 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:12:16 user nova-compute[72000]:   <target dev="vdc" bus="virtio"/>
Aug 16 18:12:16 user nova-compute[72000]:   <serial>e617ca85-92ab-49a5-a034-6e9e1fe5f50d</serial>
Aug 16 18:12:16 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 18:12:16 user nova-compute[72000]: </disk>
Aug 16 18:12:16 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:12:16 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Successfully detached device vdc from instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd from the persistent domain config.
Aug 16 18:12:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:12:16 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:12:16 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:12:16 user nova-compute[72000]:   <target dev="vdc" bus="virtio"/>
Aug 16 18:12:16 user nova-compute[72000]:   <serial>e617ca85-92ab-49a5-a034-6e9e1fe5f50d</serial>
Aug 16 18:12:16 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 18:12:16 user nova-compute[72000]: </disk>
Aug 16 18:12:16 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209536.615833, 35f9ef3c-4dd4-431b-997c-7c0f91d035cd => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:12:16 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Successfully detached device vdc from instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd from the live domain config.
Aug 16 18:12:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MNqpEXHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:12:16 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbbccf9-ae96-4acd-8d3e-16093bb7c521]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a42b55-5dea-4187-9d81-e6e714be8939]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:12:16 user nova-compute[72000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:12:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d (non-flash)
Aug 16 18:12:16 user nova-compute[72000]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:12:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01139a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dddf18-d15a-4e51-b248-d57ad58951b4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[325e2566-79ec-4db8-9370-ac1c5f14b525]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf61f18c-0db7-4b55-9569-6f64d2f01895]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb125e3a-136d-4b90-94e9-e3e3d1d17516]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.088s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b90866-4e2e-41b3-81b7-bde74b3ad596]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[832ea62b-20c4-412e-a472-31df7658a50d]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d, portal: 172.16.0.220,3260]
Aug 16 18:12:16 user nova-compute[72000]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d, portal: 172.16.0.220,3260] successful.
Aug 16 18:12:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e617ca85-92ab-49a5-a034-6e9e1fe5f50d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90af3c63-5136-4ff1-bdfd-4f9a1bbf51b9]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] <== disconnect_volume: return (351ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:12:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:12:17 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'flavor' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:12:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae028f92-f424-478a-87ec-99d729c068f5 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.901s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updating instance_info_cache with network_info: [{"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:12:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:12:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:12:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:12:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:12:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:12:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:12:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:12:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:12:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7513MB free_disk=23.843387603759766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 1c23cfa1-85f3-4387-8d20-6ca528da4036 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 97b7a046-8dd5-4a68-9a60-470881815521 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance edc29b70-1de4-4824-a0f9-b7be23570630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:12:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Acquiring lock "97b7a046-8dd5-4a68-9a60-470881815521" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "97b7a046-8dd5-4a68-9a60-470881815521" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Acquiring lock "97b7a046-8dd5-4a68-9a60-470881815521-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "97b7a046-8dd5-4a68-9a60-470881815521-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "97b7a046-8dd5-4a68-9a60-470881815521-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:37 user nova-compute[72000]: INFO nova.compute.manager [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Terminating instance
Aug 16 18:12:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:12:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-38286de5-478a-4584-82f7-5a99bf0ae559 req-7c8d96fb-cb73-4d0f-b5da-da2c1e538ee6 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Received event network-vif-unplugged-010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-38286de5-478a-4584-82f7-5a99bf0ae559 req-7c8d96fb-cb73-4d0f-b5da-da2c1e538ee6 service nova] Acquiring lock "97b7a046-8dd5-4a68-9a60-470881815521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-38286de5-478a-4584-82f7-5a99bf0ae559 req-7c8d96fb-cb73-4d0f-b5da-da2c1e538ee6 service nova] Lock "97b7a046-8dd5-4a68-9a60-470881815521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-38286de5-478a-4584-82f7-5a99bf0ae559 req-7c8d96fb-cb73-4d0f-b5da-da2c1e538ee6 service nova] Lock "97b7a046-8dd5-4a68-9a60-470881815521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-38286de5-478a-4584-82f7-5a99bf0ae559 req-7c8d96fb-cb73-4d0f-b5da-da2c1e538ee6 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] No waiting events found dispatching network-vif-unplugged-010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-38286de5-478a-4584-82f7-5a99bf0ae559 req-7c8d96fb-cb73-4d0f-b5da-da2c1e538ee6 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Received event network-vif-unplugged-010c7b3f-560c-4f8b-825d-1274336bc8aa for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:12:38 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Instance destroyed successfully.
Aug 16 18:12:38 user nova-compute[72000]: DEBUG nova.objects.instance [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lazy-loading 'resources' on Instance uuid 97b7a046-8dd5-4a68-9a60-470881815521 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2102083361',display_name='tempest-VolumesNegativeTest-instance-2102083361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2102083361',id=22,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:10:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17679e3b7c424f1db8881c1e33fb5db8',ramdisk_id='',reservation_id='r-xlkletvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1052736425',owner_user_name='tempest-VolumesNegativeTest-1052736425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:10:55Z,user_data=None,user_id='29e08b38460543b6ac28f4ce93408125',uuid=97b7a046-8dd5-4a68-9a60-470881815521,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "address": "fa:16:3e:c4:40:c6", "network": {"id": "62a7a2f8-29e8-40cc-a8ca-4f434d51969e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6a9b1e19a41b48d58c2fc8559ff091a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010c7b3f-56", "ovs_interfaceid": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Converting VIF {"id": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "address": "fa:16:3e:c4:40:c6", "network": {"id": "62a7a2f8-29e8-40cc-a8ca-4f434d51969e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6a9b1e19a41b48d58c2fc8559ff091a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap010c7b3f-56", "ovs_interfaceid": "010c7b3f-560c-4f8b-825d-1274336bc8aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=010c7b3f-560c-4f8b-825d-1274336bc8aa,network=Network(62a7a2f8-29e8-40cc-a8ca-4f434d51969e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010c7b3f-56') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG os_vif [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=010c7b3f-560c-4f8b-825d-1274336bc8aa,network=Network(62a7a2f8-29e8-40cc-a8ca-4f434d51969e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010c7b3f-56') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap010c7b3f-56, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:12:38 user nova-compute[72000]: INFO os_vif [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:40:c6,bridge_name='br-int',has_traffic_filtering=True,id=010c7b3f-560c-4f8b-825d-1274336bc8aa,network=Network(62a7a2f8-29e8-40cc-a8ca-4f434d51969e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap010c7b3f-56')
Aug 16 18:12:38 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Deleting instance files /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521_del
Aug 16 18:12:38 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Deletion of /opt/stack/data/nova/instances/97b7a046-8dd5-4a68-9a60-470881815521_del complete
Aug 16 18:12:38 user nova-compute[72000]: INFO nova.compute.manager [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 18:12:38 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:12:38 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:12:39 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:12:39 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Took 0.62 seconds to deallocate network for instance.
Aug 16 18:12:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-644887c9-959e-45e3-a760-b2701f3cb9f7 req-5cdea7da-afee-4559-ac22-e16b2c126f7c service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Received event network-vif-deleted-010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:12:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:39 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:12:39 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:12:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:39 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Deleted allocations for instance 97b7a046-8dd5-4a68-9a60-470881815521
Aug 16 18:12:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-bab5bfb7-47ea-4297-b0e5-b354c4386db2 tempest-VolumesNegativeTest-1052736425 tempest-VolumesNegativeTest-1052736425-project-member] Lock "97b7a046-8dd5-4a68-9a60-470881815521" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.951s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-b4f66a85-0178-4a08-8e3c-410cd03ac71e req-2b9d193b-7544-477b-8c11-4bd1cb41d2c7 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Received event network-vif-plugged-010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:12:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b4f66a85-0178-4a08-8e3c-410cd03ac71e req-2b9d193b-7544-477b-8c11-4bd1cb41d2c7 service nova] Acquiring lock "97b7a046-8dd5-4a68-9a60-470881815521-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b4f66a85-0178-4a08-8e3c-410cd03ac71e req-2b9d193b-7544-477b-8c11-4bd1cb41d2c7 service nova] Lock "97b7a046-8dd5-4a68-9a60-470881815521-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b4f66a85-0178-4a08-8e3c-410cd03ac71e req-2b9d193b-7544-477b-8c11-4bd1cb41d2c7 service nova] Lock "97b7a046-8dd5-4a68-9a60-470881815521-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-b4f66a85-0178-4a08-8e3c-410cd03ac71e req-2b9d193b-7544-477b-8c11-4bd1cb41d2c7 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] No waiting events found dispatching network-vif-plugged-010c7b3f-560c-4f8b-825d-1274336bc8aa {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:12:40 user nova-compute[72000]: WARNING nova.compute.manager [req-b4f66a85-0178-4a08-8e3c-410cd03ac71e req-2b9d193b-7544-477b-8c11-4bd1cb41d2c7 service nova] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Received unexpected event network-vif-plugged-010c7b3f-560c-4f8b-825d-1274336bc8aa for instance with vm_state deleted and task_state None.
Aug 16 18:12:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-b611c85d-9cd7-45a4-90e6-9d83d08508df req-2021aa5b-c231-47a0-9715-6f0d8a2b4691 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-changed-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-b611c85d-9cd7-45a4-90e6-9d83d08508df req-2021aa5b-c231-47a0-9715-6f0d8a2b4691 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Refreshing instance network info cache due to event network-changed-52283d99-7220-49dd-92cd-8489ee426bc1. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b611c85d-9cd7-45a4-90e6-9d83d08508df req-2021aa5b-c231-47a0-9715-6f0d8a2b4691 service nova] Acquiring lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b611c85d-9cd7-45a4-90e6-9d83d08508df req-2021aa5b-c231-47a0-9715-6f0d8a2b4691 service nova] Acquired lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG nova.network.neutron [req-b611c85d-9cd7-45a4-90e6-9d83d08508df req-2021aa5b-c231-47a0-9715-6f0d8a2b4691 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Refreshing network info cache for port 52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG nova.network.neutron [req-b611c85d-9cd7-45a4-90e6-9d83d08508df req-2021aa5b-c231-47a0-9715-6f0d8a2b4691 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updated VIF entry in instance network info cache for port 52283d99-7220-49dd-92cd-8489ee426bc1. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG nova.network.neutron [req-b611c85d-9cd7-45a4-90e6-9d83d08508df req-2021aa5b-c231-47a0-9715-6f0d8a2b4691 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updating instance_info_cache with network_info: [{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b611c85d-9cd7-45a4-90e6-9d83d08508df req-2021aa5b-c231-47a0-9715-6f0d8a2b4691 service nova] Releasing lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "89561a1c-6fae-4ded-865b-d338e86e40d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:43 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:12:43 user nova-compute[72000]: INFO nova.compute.claims [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Claim successful on node user
Aug 16 18:12:44 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:12:44 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:12:44 user nova-compute[72000]: INFO nova.compute.manager [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] instance snapshotting
Aug 16 18:12:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:12:44 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Beginning live snapshot process
Aug 16 18:12:44 user nova-compute[72000]: DEBUG nova.policy [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e80d9a8665e34853897db6bd52e55b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f251cf3c6455cb4f5beb33be18cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:12:44 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Creating image(s)
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "/opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "/opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "/opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json -f qcow2 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.199s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json -f qcow2 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk 1073741824" returned: 0 in 0.059s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Successfully created port: 68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuycjtu0p/db67bd44432e4803ba4d3886222d97f7.delta 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuycjtu0p/db67bd44432e4803ba4d3886222d97f7.delta 1073741824" returned: 0 in 0.059s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:45 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 18:12:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Cannot resize image /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'migration_context' on Instance uuid 89561a1c-6fae-4ded-865b-d338e86e40d8 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Ensure instance console log exists: /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Successfully updated port: 68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "refresh_cache-89561a1c-6fae-4ded-865b-d338e86e40d8" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquired lock "refresh_cache-89561a1c-6fae-4ded-865b-d338e86e40d8" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.compute.manager [req-8181dd75-5316-4821-b87f-881c9fd7064a req-bbab4eee-8ea6-432d-b821-c70885303596 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received event network-changed-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.compute.manager [req-8181dd75-5316-4821-b87f-881c9fd7064a req-bbab4eee-8ea6-432d-b821-c70885303596 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Refreshing instance network info cache due to event network-changed-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8181dd75-5316-4821-b87f-881c9fd7064a req-bbab4eee-8ea6-432d-b821-c70885303596 service nova] Acquiring lock "refresh_cache-89561a1c-6fae-4ded-865b-d338e86e40d8" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Updating instance_info_cache with network_info: [{"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Releasing lock "refresh_cache-89561a1c-6fae-4ded-865b-d338e86e40d8" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Instance network_info: |[{"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8181dd75-5316-4821-b87f-881c9fd7064a req-bbab4eee-8ea6-432d-b821-c70885303596 service nova] Acquired lock "refresh_cache-89561a1c-6fae-4ded-865b-d338e86e40d8" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.neutron [req-8181dd75-5316-4821-b87f-881c9fd7064a req-bbab4eee-8ea6-432d-b821-c70885303596 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Refreshing network info cache for port 68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Start _get_guest_xml network_info=[{"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] COPY block job progress, current cursor: 24772608 final cursor: 75563008 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:12:46 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:12:46 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1535869376',display_name='tempest-VolumesSnapshotTestJSON-instance-1535869376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1535869376',id=25,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFq7xvRIOl1VZ1ploiuuyZVolWn4EdyGs5cdJRMiWYFo6W/z4E9n1L70i6WxbKN/xBsWC//UuPVPYKq/YIxOa2k1cxEWSsjb3RsmB4HrdEoJ+zUsdTWxU5TnSQsl+wzw8w==',key_name='tempest-keypair-1215735593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='502f251cf3c6455cb4f5beb33be18cce',ramdisk_id='',reservation_id='r-v84vud0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2014651615',owner_user_name='tempest-VolumesSnapshotTestJSON-2014651615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e80d9a8665e34853897db6bd52e55b87',uuid=89561a1c-6fae-4ded-865b-d338e86e40d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converting VIF {"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:83:dc,bridge_name='br-int',has_traffic_filtering=True,id=68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d2b5b6-dc') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'pci_devices' on Instance uuid 89561a1c-6fae-4ded-865b-d338e86e40d8 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:12:46 user nova-compute[72000]:   <uuid>89561a1c-6fae-4ded-865b-d338e86e40d8</uuid>
Aug 16 18:12:46 user nova-compute[72000]:   <name>instance-00000019</name>
Aug 16 18:12:46 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:12:46 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:12:46 user nova-compute[72000]:   <metadata>
Aug 16 18:12:46 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:12:46 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:12:46 user nova-compute[72000]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1535869376</nova:name>
Aug 16 18:12:46 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:12:46</nova:creationTime>
Aug 16 18:12:46 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:12:46 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:12:46 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:12:46 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:12:46 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:12:46 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:12:46 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:12:46 user nova-compute[72000]:       <nova:owner>
Aug 16 18:12:46 user nova-compute[72000]:         <nova:user uuid="e80d9a8665e34853897db6bd52e55b87">tempest-VolumesSnapshotTestJSON-2014651615-project-member</nova:user>
Aug 16 18:12:46 user nova-compute[72000]:         <nova:project uuid="502f251cf3c6455cb4f5beb33be18cce">tempest-VolumesSnapshotTestJSON-2014651615</nova:project>
Aug 16 18:12:46 user nova-compute[72000]:       </nova:owner>
Aug 16 18:12:46 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:12:46 user nova-compute[72000]:       <nova:ports>
Aug 16 18:12:46 user nova-compute[72000]:         <nova:port uuid="68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0">
Aug 16 18:12:46 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 18:12:46 user nova-compute[72000]:         </nova:port>
Aug 16 18:12:46 user nova-compute[72000]:       </nova:ports>
Aug 16 18:12:46 user nova-compute[72000]:     </nova:instance>
Aug 16 18:12:46 user nova-compute[72000]:   </metadata>
Aug 16 18:12:46 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:12:46 user nova-compute[72000]:     <system>
Aug 16 18:12:46 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:12:46 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:12:46 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:12:46 user nova-compute[72000]:       <entry name="serial">89561a1c-6fae-4ded-865b-d338e86e40d8</entry>
Aug 16 18:12:46 user nova-compute[72000]:       <entry name="uuid">89561a1c-6fae-4ded-865b-d338e86e40d8</entry>
Aug 16 18:12:46 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:12:46 user nova-compute[72000]:     </system>
Aug 16 18:12:46 user nova-compute[72000]:   </sysinfo>
Aug 16 18:12:46 user nova-compute[72000]:   <os>
Aug 16 18:12:46 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:12:46 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:12:46 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:12:46 user nova-compute[72000]:   </os>
Aug 16 18:12:46 user nova-compute[72000]:   <features>
Aug 16 18:12:46 user nova-compute[72000]:     <acpi/>
Aug 16 18:12:46 user nova-compute[72000]:     <apic/>
Aug 16 18:12:46 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:12:46 user nova-compute[72000]:   </features>
Aug 16 18:12:46 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:12:46 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:12:46 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:12:46 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:12:46 user nova-compute[72000]:   </clock>
Aug 16 18:12:46 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:12:46 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:12:46 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:12:46 user nova-compute[72000]:   </cpu>
Aug 16 18:12:46 user nova-compute[72000]:   <devices>
Aug 16 18:12:46 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:12:46 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:12:46 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk"/>
Aug 16 18:12:46 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:12:46 user nova-compute[72000]:     </disk>
Aug 16 18:12:46 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:12:46 user nova-compute[72000]:       <mac address="fa:16:3e:99:83:dc"/>
Aug 16 18:12:46 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:12:46 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:12:46 user nova-compute[72000]:       <target dev="tap68d2b5b6-dc"/>
Aug 16 18:12:46 user nova-compute[72000]:     </interface>
Aug 16 18:12:46 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:12:46 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/console.log" append="off"/>
Aug 16 18:12:46 user nova-compute[72000]:     </serial>
Aug 16 18:12:46 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:12:46 user nova-compute[72000]:     <video>
Aug 16 18:12:46 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:12:46 user nova-compute[72000]:     </video>
Aug 16 18:12:46 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:12:46 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:12:46 user nova-compute[72000]:     </rng>
Aug 16 18:12:46 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:12:46 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:12:46 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:12:46 user nova-compute[72000]:     </memballoon>
Aug 16 18:12:46 user nova-compute[72000]:   </devices>
Aug 16 18:12:46 user nova-compute[72000]: </domain>
Aug 16 18:12:46 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1535869376',display_name='tempest-VolumesSnapshotTestJSON-instance-1535869376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1535869376',id=25,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFq7xvRIOl1VZ1ploiuuyZVolWn4EdyGs5cdJRMiWYFo6W/z4E9n1L70i6WxbKN/xBsWC//UuPVPYKq/YIxOa2k1cxEWSsjb3RsmB4HrdEoJ+zUsdTWxU5TnSQsl+wzw8w==',key_name='tempest-keypair-1215735593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='502f251cf3c6455cb4f5beb33be18cce',ramdisk_id='',reservation_id='r-v84vud0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2014651615',owner_user_name='tempest-VolumesSnapshotTestJSON-2014651615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e80d9a8665e34853897db6bd52e55b87',uuid=89561a1c-6fae-4ded-865b-d338e86e40d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converting VIF {"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:83:dc,bridge_name='br-int',has_traffic_filtering=True,id=68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d2b5b6-dc') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG os_vif [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:83:dc,bridge_name='br-int',has_traffic_filtering=True,id=68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d2b5b6-dc') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68d2b5b6-dc, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68d2b5b6-dc, col_values=(('external_ids', {'iface-id': '68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:83:dc', 'vm-uuid': '89561a1c-6fae-4ded-865b-d338e86e40d8'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:46 user nova-compute[72000]: INFO os_vif [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:83:dc,bridge_name='br-int',has_traffic_filtering=True,id=68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d2b5b6-dc')
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] No VIF found with MAC fa:16:3e:99:83:dc, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.neutron [req-8181dd75-5316-4821-b87f-881c9fd7064a req-bbab4eee-8ea6-432d-b821-c70885303596 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Updated VIF entry in instance network info cache for port 68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG nova.network.neutron [req-8181dd75-5316-4821-b87f-881c9fd7064a req-bbab4eee-8ea6-432d-b821-c70885303596 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Updating instance_info_cache with network_info: [{"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:12:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8181dd75-5316-4821-b87f-881c9fd7064a req-bbab4eee-8ea6-432d-b821-c70885303596 service nova] Releasing lock "refresh_cache-89561a1c-6fae-4ded-865b-d338e86e40d8" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:12:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:12:47 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 18:12:47 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:12:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuycjtu0p/db67bd44432e4803ba4d3886222d97f7.delta /opt/stack/data/nova/instances/snapshots/tmpuycjtu0p/db67bd44432e4803ba4d3886222d97f7 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuycjtu0p/db67bd44432e4803ba4d3886222d97f7.delta /opt/stack/data/nova/instances/snapshots/tmpuycjtu0p/db67bd44432e4803ba4d3886222d97f7" returned: 0 in 0.926s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:12:48 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Snapshot extracted, beginning image upload
Aug 16 18:12:48 user nova-compute[72000]: DEBUG nova.compute.manager [req-9c28450d-360d-420f-8bf9-ead663d14090 req-78d372df-c18d-4a68-a01f-2414ae3331ad service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received event network-vif-plugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9c28450d-360d-420f-8bf9-ead663d14090 req-78d372df-c18d-4a68-a01f-2414ae3331ad service nova] Acquiring lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9c28450d-360d-420f-8bf9-ead663d14090 req-78d372df-c18d-4a68-a01f-2414ae3331ad service nova] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9c28450d-360d-420f-8bf9-ead663d14090 req-78d372df-c18d-4a68-a01f-2414ae3331ad service nova] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG nova.compute.manager [req-9c28450d-360d-420f-8bf9-ead663d14090 req-78d372df-c18d-4a68-a01f-2414ae3331ad service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] No waiting events found dispatching network-vif-plugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:12:48 user nova-compute[72000]: WARNING nova.compute.manager [req-9c28450d-360d-420f-8bf9-ead663d14090 req-78d372df-c18d-4a68-a01f-2414ae3331ad service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received unexpected event network-vif-plugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 for instance with vm_state building and task_state spawning.
Aug 16 18:12:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209570.2790647, 89561a1c-6fae-4ded-865b-d338e86e40d8 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:12:50 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] VM Resumed (Lifecycle Event)
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:12:50 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Instance spawned successfully.
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:12:50 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209570.2811918, 89561a1c-6fae-4ded-865b-d338e86e40d8 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:12:50 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] VM Started (Lifecycle Event)
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:12:50 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-4d71e5d7-d53a-4579-8420-a85d8ea24c7e req-1c117146-7b51-475d-abba-14eacafa421b service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received event network-vif-plugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4d71e5d7-d53a-4579-8420-a85d8ea24c7e req-1c117146-7b51-475d-abba-14eacafa421b service nova] Acquiring lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4d71e5d7-d53a-4579-8420-a85d8ea24c7e req-1c117146-7b51-475d-abba-14eacafa421b service nova] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4d71e5d7-d53a-4579-8420-a85d8ea24c7e req-1c117146-7b51-475d-abba-14eacafa421b service nova] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-4d71e5d7-d53a-4579-8420-a85d8ea24c7e req-1c117146-7b51-475d-abba-14eacafa421b service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] No waiting events found dispatching network-vif-plugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:12:50 user nova-compute[72000]: WARNING nova.compute.manager [req-4d71e5d7-d53a-4579-8420-a85d8ea24c7e req-1c117146-7b51-475d-abba-14eacafa421b service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received unexpected event network-vif-plugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 for instance with vm_state building and task_state spawning.
Aug 16 18:12:50 user nova-compute[72000]: INFO nova.compute.manager [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Took 6.42 seconds to spawn the instance on the hypervisor.
Aug 16 18:12:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:12:51 user nova-compute[72000]: INFO nova.compute.manager [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Took 7.44 seconds to build instance.
Aug 16 18:12:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d030f5-24c3-44bb-b6d5-5cd7c63df567 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.550s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:12:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Snapshot image upload complete
Aug 16 18:12:51 user nova-compute[72000]: INFO nova.compute.manager [None req-bd64a217-b70e-40b5-9215-75d2f037b238 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Took 6.99 seconds to snapshot the instance on the hypervisor.
Aug 16 18:12:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:53 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209558.568147, 97b7a046-8dd5-4a68-9a60-470881815521 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:12:53 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] VM Stopped (Lifecycle Event)
Aug 16 18:12:53 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2a98861e-5ba3-45fb-9c81-a2a9b00416e9 None None] [instance: 97b7a046-8dd5-4a68-9a60-470881815521] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:12:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-e314e782-feeb-41c0-af00-6ef56a7d48dc req-27a0e457-6497-46b7-bdd8-484d38c3b578 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received event network-changed-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:12:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-e314e782-feeb-41c0-af00-6ef56a7d48dc req-27a0e457-6497-46b7-bdd8-484d38c3b578 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Refreshing instance network info cache due to event network-changed-c2b2f625-3095-4388-81e3-a180e303b684. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:12:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e314e782-feeb-41c0-af00-6ef56a7d48dc req-27a0e457-6497-46b7-bdd8-484d38c3b578 service nova] Acquiring lock "refresh_cache-edc29b70-1de4-4824-a0f9-b7be23570630" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:12:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e314e782-feeb-41c0-af00-6ef56a7d48dc req-27a0e457-6497-46b7-bdd8-484d38c3b578 service nova] Acquired lock "refresh_cache-edc29b70-1de4-4824-a0f9-b7be23570630" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:12:55 user nova-compute[72000]: DEBUG nova.network.neutron [req-e314e782-feeb-41c0-af00-6ef56a7d48dc req-27a0e457-6497-46b7-bdd8-484d38c3b578 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Refreshing network info cache for port c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:12:56 user nova-compute[72000]: DEBUG nova.network.neutron [req-e314e782-feeb-41c0-af00-6ef56a7d48dc req-27a0e457-6497-46b7-bdd8-484d38c3b578 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Updated VIF entry in instance network info cache for port c2b2f625-3095-4388-81e3-a180e303b684. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:12:56 user nova-compute[72000]: DEBUG nova.network.neutron [req-e314e782-feeb-41c0-af00-6ef56a7d48dc req-27a0e457-6497-46b7-bdd8-484d38c3b578 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Updating instance_info_cache with network_info: [{"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:12:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e314e782-feeb-41c0-af00-6ef56a7d48dc req-27a0e457-6497-46b7-bdd8-484d38c3b578 service nova] Releasing lock "refresh_cache-edc29b70-1de4-4824-a0f9-b7be23570630" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:12:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:12:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:03 user nova-compute[72000]: INFO nova.compute.manager [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Attaching volume f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 to /dev/vdb
Aug 16 18:13:03 user nova-compute[72000]: DEBUG os_brick.utils [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bb0174-ebb9-4afc-bd32-dc1ed8102c23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4832992f-7f80-4429-9a87-72afc45a9219]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca941ec-8ea3-4515-999d-c1743851d220]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9437b8ab-3f2c-4379-84ca-5164fdf5ea22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:13:03 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:13:03 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1116cebe-aa46-4dd3-9cf8-456d27129d84]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG os_brick.utils [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:13:03 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Updating existing volume attachment record: cdcf1ce0-eee2-4721-ab41-1ddafdb7a977 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:06 user nova-compute[72000]: INFO nova.compute.manager [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Terminating instance
Aug 16 18:13:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-01cffcc4-1bf7-4195-a587-9873438d6545 req-5a9abfd0-ba36-4927-9830-bff5843c3ac4 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-vif-unplugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-01cffcc4-1bf7-4195-a587-9873438d6545 req-5a9abfd0-ba36-4927-9830-bff5843c3ac4 service nova] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-01cffcc4-1bf7-4195-a587-9873438d6545 req-5a9abfd0-ba36-4927-9830-bff5843c3ac4 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-01cffcc4-1bf7-4195-a587-9873438d6545 req-5a9abfd0-ba36-4927-9830-bff5843c3ac4 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-01cffcc4-1bf7-4195-a587-9873438d6545 req-5a9abfd0-ba36-4927-9830-bff5843c3ac4 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] No waiting events found dispatching network-vif-unplugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:13:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-01cffcc4-1bf7-4195-a587-9873438d6545 req-5a9abfd0-ba36-4927-9830-bff5843c3ac4 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-vif-unplugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:13:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Instance destroyed successfully.
Aug 16 18:13:07 user nova-compute[72000]: DEBUG nova.objects.instance [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'resources' on Instance uuid 35f9ef3c-4dd4-431b-997c-7c0f91d035cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:06:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2067903681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2067903681',id=20,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzAIQ4Qj/buGVYTF9Q5oTXmTmubqVmbfas/Gwlki1gZXYF6B7LxmZeceF68CptfGwnNe4ghrEiOtNYM248dcgGpuXQVyEeF0szdyiRkBTm+GkDoH8E6uKhsqsrzOoZwgg==',key_name='tempest-keypair-627413116',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:10:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-zfoj5n1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:10:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=35f9ef3c-4dd4-431b-997c-7c0f91d035cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:13:07 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "address": "fa:16:3e:95:83:32", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap570f94a4-3d", "ovs_interfaceid": "570f94a4-3d2e-44e9-931f-147ee993a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:13:07 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:13:07 user nova-compute[72000]: DEBUG os_vif [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:13:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap570f94a4-3d, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:13:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:07 user nova-compute[72000]: INFO os_vif [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:83:32,bridge_name='br-int',has_traffic_filtering=True,id=570f94a4-3d2e-44e9-931f-147ee993a9e2,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap570f94a4-3d')
Aug 16 18:13:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Deleting instance files /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd_del
Aug 16 18:13:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Deletion of /opt/stack/data/nova/instances/35f9ef3c-4dd4-431b-997c-7c0f91d035cd_del complete
Aug 16 18:13:07 user nova-compute[72000]: INFO nova.compute.manager [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 16 18:13:07 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:13:07 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:13:07 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:13:08 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Took 1.11 seconds to deallocate network for instance.
Aug 16 18:13:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:08 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Deleted allocations for instance 35f9ef3c-4dd4-431b-997c-7c0f91d035cd
Aug 16 18:13:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-44cec4a7-03c0-4a43-89e7-425351603a68 req-620582fb-4793-456a-a253-98c16e30b5c1 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-44cec4a7-03c0-4a43-89e7-425351603a68 req-620582fb-4793-456a-a253-98c16e30b5c1 service nova] Acquiring lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-44cec4a7-03c0-4a43-89e7-425351603a68 req-620582fb-4793-456a-a253-98c16e30b5c1 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-44cec4a7-03c0-4a43-89e7-425351603a68 req-620582fb-4793-456a-a253-98c16e30b5c1 service nova] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-44cec4a7-03c0-4a43-89e7-425351603a68 req-620582fb-4793-456a-a253-98c16e30b5c1 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] No waiting events found dispatching network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:13:08 user nova-compute[72000]: WARNING nova.compute.manager [req-44cec4a7-03c0-4a43-89e7-425351603a68 req-620582fb-4793-456a-a253-98c16e30b5c1 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received unexpected event network-vif-plugged-570f94a4-3d2e-44e9-931f-147ee993a9e2 for instance with vm_state deleted and task_state None.
Aug 16 18:13:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-44cec4a7-03c0-4a43-89e7-425351603a68 req-620582fb-4793-456a-a253-98c16e30b5c1 service nova] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Received event network-vif-deleted-570f94a4-3d2e-44e9-931f-147ee993a9e2 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7733cb5c-1b83-4286-867a-0b806d8538fc tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "35f9ef3c-4dd4-431b-997c-7c0f91d035cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.572s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:12 user nova-compute[72000]: INFO nova.compute.manager [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Terminating instance
Aug 16 18:13:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-342dfbe3-4db6-4f63-b05f-11924fd60ff2 req-30f2b3fc-5dd1-4634-97e9-9f6ec5d5d4e7 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-vif-unplugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-342dfbe3-4db6-4f63-b05f-11924fd60ff2 req-30f2b3fc-5dd1-4634-97e9-9f6ec5d5d4e7 service nova] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-342dfbe3-4db6-4f63-b05f-11924fd60ff2 req-30f2b3fc-5dd1-4634-97e9-9f6ec5d5d4e7 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-342dfbe3-4db6-4f63-b05f-11924fd60ff2 req-30f2b3fc-5dd1-4634-97e9-9f6ec5d5d4e7 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-342dfbe3-4db6-4f63-b05f-11924fd60ff2 req-30f2b3fc-5dd1-4634-97e9-9f6ec5d5d4e7 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] No waiting events found dispatching network-vif-unplugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:13:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-342dfbe3-4db6-4f63-b05f-11924fd60ff2 req-30f2b3fc-5dd1-4634-97e9-9f6ec5d5d4e7 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-vif-unplugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Instance destroyed successfully.
Aug 16 18:13:13 user nova-compute[72000]: DEBUG nova.objects.instance [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lazy-loading 'resources' on Instance uuid 1c23cfa1-85f3-4387-8d20-6ca528da4036 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1372916711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-681785428',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJlak2tOt9cBSjKnpDOfBeJRnXtSHC7w9mhcXjMleWm/v+NlNOnrvgK4h4DHZbJvfyMIQpiEmOMooTgiAJinHvhdGlplkZTUezGZ8m8aOqaEKOAfUdsDEee41ceWhBWEw==',key_name='tempest-keypair-372649896',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0a3d62962234183abd3a9e821f4df0f',ramdisk_id='',reservation_id='r-w9xfuhbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1522344658',owner_user_name='tempest-ServerActionsV293TestJSON-1522344658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8955d5f063374ad18e8f055029e551c3',uuid=1c23cfa1-85f3-4387-8d20-6ca528da4036,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converting VIF {"id": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "address": "fa:16:3e:95:6f:01", "network": {"id": "e907ac3a-9ed0-400e-aee1-b4ab9f55aa70", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1134499728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a3d62962234183abd3a9e821f4df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b698323-ed", "ovs_interfaceid": "5b698323-edd3-4918-ac17-58e8f9c67ca5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_vif [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b698323-ed, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:13:13 user nova-compute[72000]: INFO os_vif [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:6f:01,bridge_name='br-int',has_traffic_filtering=True,id=5b698323-edd3-4918-ac17-58e8f9c67ca5,network=Network(e907ac3a-9ed0-400e-aee1-b4ab9f55aa70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b698323-ed')
Aug 16 18:13:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpEoGQmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:13:13 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc0bfb3-95bb-4d71-8946-20b81af3242c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee5c242-26a4-4d6f-aeb7-c16a6395d6fe]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:13:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d (non-flash)
Aug 16 18:13:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd010242290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9766615b-2190-4e46-be71-ab70e7759945]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[05daf734-ce08-4866-a7c2-c92032e06a3f]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ad79af-7bac-449e-aded-a38263691946]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[44545f23-d714-468a-a89f-d50d8ddbfc56]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7f0db804-5383f414f54633ce', '/dev/disk/by-id/scsi-23533383366343134', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7f0db804') {{(pid=83463) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[247f4c32-4813-4d24-9fc6-ed654654d926]: (4, None) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25bbd44-a5ee-4637-a3cb-e24862e33e78]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[664306ab-ea3b-4db0-95d7-cb7f64684550]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260]
Aug 16 18:13:13 user nova-compute[72000]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d, portal: 172.16.0.220,3260] successful.
Aug 16 18:13:13 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7398e7e7-2dd3-4d02-b901-01279856260d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee094438-3545-49d3-a1a7-ddff5b00850d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] <== disconnect_volume: return (291ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:13:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Deleting instance files /opt/stack/data/nova/instances/1c23cfa1-85f3-4387-8d20-6ca528da4036_del
Aug 16 18:13:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Deletion of /opt/stack/data/nova/instances/1c23cfa1-85f3-4387-8d20-6ca528da4036_del complete
Aug 16 18:13:13 user nova-compute[72000]: INFO nova.compute.manager [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 16 18:13:13 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:13:13 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghzuMbTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:13:14 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:13:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:13:14 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:13:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:13:14 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[194cd615-1982-4760-91d7-a653b0308152]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:13:14 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-ee584530-1c0e-4276-a4cb-38d11c8dac42 req-5b620a69-66d4-4d6f-9d96-9f83670be002 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ee584530-1c0e-4276-a4cb-38d11c8dac42 req-5b620a69-66d4-4d6f-9d96-9f83670be002 service nova] Acquiring lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ee584530-1c0e-4276-a4cb-38d11c8dac42 req-5b620a69-66d4-4d6f-9d96-9f83670be002 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ee584530-1c0e-4276-a4cb-38d11c8dac42 req-5b620a69-66d4-4d6f-9d96-9f83670be002 service nova] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-ee584530-1c0e-4276-a4cb-38d11c8dac42 req-5b620a69-66d4-4d6f-9d96-9f83670be002 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] No waiting events found dispatching network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:13:14 user nova-compute[72000]: WARNING nova.compute.manager [req-ee584530-1c0e-4276-a4cb-38d11c8dac42 req-5b620a69-66d4-4d6f-9d96-9f83670be002 service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received unexpected event network-vif-plugged-5b698323-edd3-4918-ac17-58e8f9c67ca5 for instance with vm_state active and task_state deleting.
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dd7b9f-0c9e-43c0-bee0-3bd43e5a6a2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3] added
Aug 16 18:13:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16eca35-244c-47fa-999e-d73f4f41d103]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daa093c-7bca-4966-8d50-ac850a2a5408]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ghzuMbTI {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ghzuMbTI" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf63108-9481-42c3-a63d-8457d6d95bfb]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ghzuMbTI'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae49d3cf-37b0-4bbd-a8f4-8ca621fdf0ba]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ae4a63-cbab-4c4f-afed-e52aeb071be3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:13:15 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:13:15 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:13:15 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 18:13:15 user nova-compute[72000]: 
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba0662e-3a24-477b-b958-cccadeac0bf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3, portal: 172.16.0.220,3260]
Aug 16 18:13:15 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3, portal: 172.16.0.220,3260] successful.
Aug 16 18:13:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c0bb87-f5aa-4292-a4f8-411b55495e9c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc29f2-56f8-4552-af19-73432c466a32]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)
Aug 16 18:13:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)
Aug 16 18:13:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2417a8-0f6c-4217-961d-78d74849c73e]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghzuMbTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:13:15 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:13:15 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Took 1.75 seconds to deallocate network for instance.
Aug 16 18:13:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23937613438643036', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937613438643036', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG nova.objects.instance [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:13:16 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:13:16 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:13:16 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:13:16 user nova-compute[72000]:   <serial>f889a92f-bc76-47a0-8480-d9cd7d9e0ad3</serial>
Aug 16 18:13:16 user nova-compute[72000]: </disk>
Aug 16 18:13:16 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:13:16 user nova-compute[72000]: INFO nova.compute.manager [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Took 0.80 seconds to detach 1 volumes for instance.
Aug 16 18:13:16 user nova-compute[72000]: DEBUG nova.compute.manager [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Deleting volume: 7398e7e7-2dd3-4d02-b901-01279856260d {{(pid=72000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:13:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No VIF found with MAC fa:16:3e:48:10:5f, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:13:16 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Deleted allocations for instance 1c23cfa1-85f3-4387-8d20-6ca528da4036
Aug 16 18:13:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-90b8f08a-8575-4a18-be89-482325919047 tempest-ServerActionsV293TestJSON-1522344658 tempest-ServerActionsV293TestJSON-1522344658-project-member] Lock "1c23cfa1-85f3-4387-8d20-6ca528da4036" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.399s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7c21d2a1-fc9b-43b9-9a51-cc0527afd877 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.290s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:17 user nova-compute[72000]: DEBUG nova.compute.manager [req-cabfd95f-4b81-4a89-920b-6757ba56f661 req-d19bfe73-f127-463a-a2e0-fdc21410446d service nova] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Received event network-vif-deleted-5b698323-edd3-4918-ac17-58e8f9c67ca5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:13:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:13:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 18:13:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:13:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:13:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:13:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:13:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:21 user nova-compute[72000]: INFO nova.compute.manager [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Attaching volume 0c530378-829a-4903-a2dc-afd197dc0ea0 to /dev/vdc
Aug 16 18:13:21 user nova-compute[72000]: DEBUG os_brick.utils [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a662275f-9324-4529-80b8-77982e348904]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9624c4-73e3-42fc-b1e9-5e468d531315]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab6fba8-b257-4c1e-bec6-741770a902b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d8eeb2-a0e1-4214-908f-838248e66ca8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:13:21 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:13:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30dd13f-2984-445c-8ebf-81721367c644]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG os_brick.utils [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:13:21 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Updating existing volume attachment record: 9c8c455d-aa80-4edd-95f5-b7cddd3281ed {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:13:22 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209587.263462, 35f9ef3c-4dd4-431b-997c-7c0f91d035cd => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:13:22 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] VM Stopped (Lifecycle Event)
Aug 16 18:13:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-536ec2e2-38e5-437d-9aa2-a472ed29b657 None None] [instance: 35f9ef3c-4dd4-431b-997c-7c0f91d035cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:13:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:13:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:13:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:25 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:13:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:28 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209593.3649573, 1c23cfa1-85f3-4387-8d20-6ca528da4036 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:13:28 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] VM Stopped (Lifecycle Event)
Aug 16 18:13:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4b32db03-8926-49f9-a3c0-4fcf86ac9f4b None None] [instance: 1c23cfa1-85f3-4387-8d20-6ca528da4036] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:13:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:28 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:13:28 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:13:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7800MB free_disk=23.810317993164062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:13:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance edc29b70-1de4-4824-a0f9-b7be23570630 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 89561a1c-6fae-4ded-865b-d338e86e40d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:13:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhKbVLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:13:32 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:13:32 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:13:32 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d972ab-3a52-4c32-aa55-a245af20f9e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:13:32 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0f89fd-7757-4dbc-b593-903dd4d70580]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0] added
Aug 16 18:13:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f569499e-6a9b-4d1c-a85b-6ca3d5006cea]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d9f040-b14c-449a-86f3-8ad35d58074b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhKbVLUC {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rhKbVLUC" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca05d99-9a14-49fc-9404-d00d60a30e8b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rhKbVLUC'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4c0c67-794c-4f17-87b3-a4e733b67edd]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efb3ee0-b03e-462a-bc2c-8737da1a4e4b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)
Aug 16 18:13:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)
Aug 16 18:13:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:13:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d8ea83-ccd2-41b3-b80c-f46f317c30a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0, portal: 172.16.0.220,3260]
Aug 16 18:13:33 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0, portal: 172.16.0.220,3260] successful.
Aug 16 18:13:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3626fa5-901e-4e02-8bcf-b2e8fd29440b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f1ba98-c715-49d4-8e6f-f06d6cb1e6e6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)
Aug 16 18:13:33 user nova-compute[72000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 (non-flash)
Aug 16 18:13:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)
Aug 16 18:13:33 user nova-compute[72000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 (non-flash)
Aug 16 18:13:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80367b5-dd3f-4a32-b837-210f3b3090d7]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhKbVLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:13:34 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26462303662323930', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:13:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462303662323930', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:13:34 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:13:34 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:13:34 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:13:34 user nova-compute[72000]:   <target dev="vdc" bus="virtio"/>
Aug 16 18:13:34 user nova-compute[72000]:   <serial>0c530378-829a-4903-a2dc-afd197dc0ea0</serial>
Aug 16 18:13:34 user nova-compute[72000]: </disk>
Aug 16 18:13:34 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:13:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:13:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:13:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:13:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] No VIF found with MAC fa:16:3e:48:10:5f, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:13:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a0eb55e0-a736-4834-9046-94711f7722bb tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.033s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:36 user nova-compute[72000]: INFO nova.compute.manager [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Detaching volume f889a92f-bc76-47a0-8480-d9cd7d9e0ad3
Aug 16 18:13:36 user nova-compute[72000]: INFO nova.virt.block_device [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Attempting to driver detach volume f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 from mountpoint /dev/vdb
Aug 16 18:13:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Attempting to detach device vdb from instance edc29b70-1de4-4824-a0f9-b7be23570630 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:13:36 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:13:36 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:13:36 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:13:36 user nova-compute[72000]:   <serial>f889a92f-bc76-47a0-8480-d9cd7d9e0ad3</serial>
Aug 16 18:13:36 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:13:36 user nova-compute[72000]: </disk>
Aug 16 18:13:36 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:13:36 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully detached device vdb from instance edc29b70-1de4-4824-a0f9-b7be23570630 from the persistent domain config.
Aug 16 18:13:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance edc29b70-1de4-4824-a0f9-b7be23570630 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:13:36 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:13:36 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:13:36 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:13:36 user nova-compute[72000]:   <serial>f889a92f-bc76-47a0-8480-d9cd7d9e0ad3</serial>
Aug 16 18:13:36 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:13:36 user nova-compute[72000]: </disk>
Aug 16 18:13:36 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209616.7738223, edc29b70-1de4-4824-a0f9-b7be23570630 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:13:36 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully detached device vdb from instance edc29b70-1de4-4824-a0f9-b7be23570630 from the live domain config.
Aug 16 18:13:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ghzuMbTI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:13:36 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2955dd1f-5d8a-4e5a-9c4c-13c6b2f56cba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638551a-362a-4ca1-9df8-a1e1a9f20a0e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)
Aug 16 18:13:36 user nova-compute[72000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 (non-flash)
Aug 16 18:13:36 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 (non-flash)
Aug 16 18:13:36 user nova-compute[72000]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 (non-flash)
Aug 16 18:13:36 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0100ef640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5531c5-32aa-49a3-8daa-f5a62204fedd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc84c609-5d14-4482-8371-a25240719a37]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cfcebf-2483-44ec-ad47-ba1e4e819d20]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[26df7b29-2378-4fee-85ad-443984901a46]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a5ac76-50c3-4e4a-9c59-84e1e110f23c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b171d493-0a87-4532-b23e-23cbb8ce89ce]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3, portal: 172.16.0.220,3260]
Aug 16 18:13:37 user nova-compute[72000]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3, portal: 172.16.0.220,3260] successful.
Aug 16 18:13:37 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f889a92f-bc76-47a0-8480-d9cd7d9e0ad3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50213296-8cfb-4856-8714-6efd8041a231]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== disconnect_volume: return (292ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:37 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:13:37 user nova-compute[72000]: INFO nova.compute.claims [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Claim successful on node user
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.objects.instance [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-7882e114-f7cc-48f1-9955-207db484379b tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.977s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:13:38 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.policy [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd07d329987884ac98b87374ca2074b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5442ba2319584631a81b2d1208b5f65f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:13:38 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Creating image(s)
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:38 user nova-compute[72000]: INFO nova.compute.manager [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Detaching volume 0c530378-829a-4903-a2dc-afd197dc0ea0
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:38 user nova-compute[72000]: INFO nova.virt.block_device [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Attempting to driver detach volume 0c530378-829a-4903-a2dc-afd197dc0ea0 from mountpoint /dev/vdc
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Attempting to detach device vdc from instance edc29b70-1de4-4824-a0f9-b7be23570630 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:13:38 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:13:38 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:13:38 user nova-compute[72000]:   <target dev="vdc" bus="virtio"/>
Aug 16 18:13:38 user nova-compute[72000]:   <serial>0c530378-829a-4903-a2dc-afd197dc0ea0</serial>
Aug 16 18:13:38 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 18:13:38 user nova-compute[72000]: </disk>
Aug 16 18:13:38 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:13:38 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully detached device vdc from instance edc29b70-1de4-4824-a0f9-b7be23570630 from the persistent domain config.
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance edc29b70-1de4-4824-a0f9-b7be23570630 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:13:38 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:13:38 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:13:38 user nova-compute[72000]:   <target dev="vdc" bus="virtio"/>
Aug 16 18:13:38 user nova-compute[72000]:   <serial>0c530378-829a-4903-a2dc-afd197dc0ea0</serial>
Aug 16 18:13:38 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 18:13:38 user nova-compute[72000]: </disk>
Aug 16 18:13:38 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk 1073741824" returned: 0 in 0.060s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Successfully created port: 675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.250s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:13:39 user nova-compute[72000]: INFO nova.compute.claims [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Claim successful on node user
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209619.3113244, edc29b70-1de4-4824-a0f9-b7be23570630 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:13:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully detached device vdc from instance edc29b70-1de4-4824-a0f9-b7be23570630 from the live domain config.
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rhKbVLUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:13:39 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7c7afe-45e6-41e9-b316-ebfe754c8b6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b94aa-138c-4227-8f06-c308d65f1638]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 (non-flash)
Aug 16 18:13:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 (non-flash)
Aug 16 18:13:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcfe872be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Cannot resize image /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'migration_context' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18503f7-4809-4202-ad36-7614c22ee609]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Ensure instance console log exists: /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[47783232-1792-4e90-b590-699fe1551871]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee10176-e71d-4af9-a265-95b980db0837]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aac692-cce4-4328-af31-4c1f95ab9a84]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3562dfa-6d33-4bfd-8416-5a5d5b4b14b1]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[51893ff0-2e81-413f-8ce0-f9082e4756ff]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0, portal: 172.16.0.220,3260]
Aug 16 18:13:39 user nova-compute[72000]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0, portal: 172.16.0.220,3260] successful.
Aug 16 18:13:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c530378-829a-4903-a2dc-afd197dc0ea0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0b0bac-f9b4-426c-a9fa-be1cbd79f7ac]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] <== disconnect_volume: return (308ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:13:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.policy [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bce14217bd604140a4082ca9f6b862c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6fe73c2955b4eddbbfd84bd9806ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:13:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Creating image(s)
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "/opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "/opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "/opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk 1073741824" returned: 0 in 0.050s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Successfully updated port: 675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-de8a3a34-6c7f-46db-ba0d-927f6a94347e req-f63f8edb-f862-4edc-93fe-5a770afdaf56 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-changed-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-de8a3a34-6c7f-46db-ba0d-927f6a94347e req-f63f8edb-f862-4edc-93fe-5a770afdaf56 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Refreshing instance network info cache due to event network-changed-675351e2-f9ae-41cd-a810-fb1d45a7186a. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-de8a3a34-6c7f-46db-ba0d-927f6a94347e req-f63f8edb-f862-4edc-93fe-5a770afdaf56 service nova] Acquiring lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-de8a3a34-6c7f-46db-ba0d-927f6a94347e req-f63f8edb-f862-4edc-93fe-5a770afdaf56 service nova] Acquired lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.network.neutron [req-de8a3a34-6c7f-46db-ba0d-927f6a94347e req-f63f8edb-f862-4edc-93fe-5a770afdaf56 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Refreshing network info cache for port 675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.network.neutron [req-de8a3a34-6c7f-46db-ba0d-927f6a94347e req-f63f8edb-f862-4edc-93fe-5a770afdaf56 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Checking if we can resize image /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'flavor' on Instance uuid edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e5271fd-3d7e-4d58-880a-ccd3c298f041 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.025s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Successfully created port: a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Cannot resize image /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'migration_context' on Instance uuid 618b087f-3794-4508-bc46-a30f888525ec {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Ensure instance console log exists: /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.network.neutron [req-de8a3a34-6c7f-46db-ba0d-927f6a94347e req-f63f8edb-f862-4edc-93fe-5a770afdaf56 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-de8a3a34-6c7f-46db-ba0d-927f6a94347e req-f63f8edb-f862-4edc-93fe-5a770afdaf56 service nova] Releasing lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquired lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:13:40 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:41 user nova-compute[72000]: INFO nova.compute.manager [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Terminating instance
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.network.neutron [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updating instance_info_cache with network_info: [{"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Releasing lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Instance network_info: |[{"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Start _get_guest_xml network_info=[{"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:41 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:13:41 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1881362050',display_name='tempest-ServerRescueNegativeTestJSON-server-1881362050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1881362050',id=26,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOax8cUTQytSdtGTyC9MeCOoaVGwmHO7ZUgzG4i+NFpXjqfhVR25SFddxqnnAXGZgfzQbOc5+YYks+mN9ZsSDQcEAlypm3l3jev6N/AWDWshdH5tGXlV+Y3ZzhzTJGdBA==',key_name='tempest-keypair-1907527833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-g5r9ilfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d07d329987884ac98b87374ca2074b86',uuid=bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:70:1c,bridge_name='br-int',has_traffic_filtering=True,id=675351e2-f9ae-41cd-a810-fb1d45a7186a,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap675351e2-f9') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.objects.instance [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'pci_devices' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:13:41 user nova-compute[72000]:   <uuid>bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d</uuid>
Aug 16 18:13:41 user nova-compute[72000]:   <name>instance-0000001a</name>
Aug 16 18:13:41 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:13:41 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:13:41 user nova-compute[72000]:   <metadata>
Aug 16 18:13:41 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:13:41 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:13:41 user nova-compute[72000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1881362050</nova:name>
Aug 16 18:13:41 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:13:41</nova:creationTime>
Aug 16 18:13:41 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:13:41 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:13:41 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:13:41 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:13:41 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:13:41 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:13:41 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:13:41 user nova-compute[72000]:       <nova:owner>
Aug 16 18:13:41 user nova-compute[72000]:         <nova:user uuid="d07d329987884ac98b87374ca2074b86">tempest-ServerRescueNegativeTestJSON-1605720785-project-member</nova:user>
Aug 16 18:13:41 user nova-compute[72000]:         <nova:project uuid="5442ba2319584631a81b2d1208b5f65f">tempest-ServerRescueNegativeTestJSON-1605720785</nova:project>
Aug 16 18:13:41 user nova-compute[72000]:       </nova:owner>
Aug 16 18:13:41 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:13:41 user nova-compute[72000]:       <nova:ports>
Aug 16 18:13:41 user nova-compute[72000]:         <nova:port uuid="675351e2-f9ae-41cd-a810-fb1d45a7186a">
Aug 16 18:13:41 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 18:13:41 user nova-compute[72000]:         </nova:port>
Aug 16 18:13:41 user nova-compute[72000]:       </nova:ports>
Aug 16 18:13:41 user nova-compute[72000]:     </nova:instance>
Aug 16 18:13:41 user nova-compute[72000]:   </metadata>
Aug 16 18:13:41 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:13:41 user nova-compute[72000]:     <system>
Aug 16 18:13:41 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:13:41 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:13:41 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:13:41 user nova-compute[72000]:       <entry name="serial">bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d</entry>
Aug 16 18:13:41 user nova-compute[72000]:       <entry name="uuid">bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d</entry>
Aug 16 18:13:41 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:13:41 user nova-compute[72000]:     </system>
Aug 16 18:13:41 user nova-compute[72000]:   </sysinfo>
Aug 16 18:13:41 user nova-compute[72000]:   <os>
Aug 16 18:13:41 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:13:41 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:13:41 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:13:41 user nova-compute[72000]:   </os>
Aug 16 18:13:41 user nova-compute[72000]:   <features>
Aug 16 18:13:41 user nova-compute[72000]:     <acpi/>
Aug 16 18:13:41 user nova-compute[72000]:     <apic/>
Aug 16 18:13:41 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:13:41 user nova-compute[72000]:   </features>
Aug 16 18:13:41 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:13:41 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:13:41 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:13:41 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:13:41 user nova-compute[72000]:   </clock>
Aug 16 18:13:41 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:13:41 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:13:41 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:13:41 user nova-compute[72000]:   </cpu>
Aug 16 18:13:41 user nova-compute[72000]:   <devices>
Aug 16 18:13:41 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:13:41 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:13:41 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk"/>
Aug 16 18:13:41 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:13:41 user nova-compute[72000]:     </disk>
Aug 16 18:13:41 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:13:41 user nova-compute[72000]:       <mac address="fa:16:3e:c8:70:1c"/>
Aug 16 18:13:41 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:13:41 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:13:41 user nova-compute[72000]:       <target dev="tap675351e2-f9"/>
Aug 16 18:13:41 user nova-compute[72000]:     </interface>
Aug 16 18:13:41 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:13:41 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/console.log" append="off"/>
Aug 16 18:13:41 user nova-compute[72000]:     </serial>
Aug 16 18:13:41 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:13:41 user nova-compute[72000]:     <video>
Aug 16 18:13:41 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:13:41 user nova-compute[72000]:     </video>
Aug 16 18:13:41 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:13:41 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:13:41 user nova-compute[72000]:     </rng>
Aug 16 18:13:41 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:13:41 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:13:41 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:13:41 user nova-compute[72000]:     </memballoon>
Aug 16 18:13:41 user nova-compute[72000]:   </devices>
Aug 16 18:13:41 user nova-compute[72000]: </domain>
Aug 16 18:13:41 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1881362050',display_name='tempest-ServerRescueNegativeTestJSON-server-1881362050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1881362050',id=26,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOax8cUTQytSdtGTyC9MeCOoaVGwmHO7ZUgzG4i+NFpXjqfhVR25SFddxqnnAXGZgfzQbOc5+YYks+mN9ZsSDQcEAlypm3l3jev6N/AWDWshdH5tGXlV+Y3ZzhzTJGdBA==',key_name='tempest-keypair-1907527833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-g5r9ilfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d07d329987884ac98b87374ca2074b86',uuid=bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:70:1c,bridge_name='br-int',has_traffic_filtering=True,id=675351e2-f9ae-41cd-a810-fb1d45a7186a,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap675351e2-f9') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG os_vif [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:70:1c,bridge_name='br-int',has_traffic_filtering=True,id=675351e2-f9ae-41cd-a810-fb1d45a7186a,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap675351e2-f9') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap675351e2-f9, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap675351e2-f9, col_values=(('external_ids', {'iface-id': '675351e2-f9ae-41cd-a810-fb1d45a7186a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:70:1c', 'vm-uuid': 'bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Successfully updated port: a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-2b51d585-d013-43b1-9f9f-48e132765410 req-af248281-da6f-45b5-8b51-ba5507f10be9 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received event network-changed-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-2b51d585-d013-43b1-9f9f-48e132765410 req-af248281-da6f-45b5-8b51-ba5507f10be9 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Refreshing instance network info cache due to event network-changed-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2b51d585-d013-43b1-9f9f-48e132765410 req-af248281-da6f-45b5-8b51-ba5507f10be9 service nova] Acquiring lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2b51d585-d013-43b1-9f9f-48e132765410 req-af248281-da6f-45b5-8b51-ba5507f10be9 service nova] Acquired lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-2b51d585-d013-43b1-9f9f-48e132765410 req-af248281-da6f-45b5-8b51-ba5507f10be9 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Refreshing network info cache for port a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:13:41 user nova-compute[72000]: INFO os_vif [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:70:1c,bridge_name='br-int',has_traffic_filtering=True,id=675351e2-f9ae-41cd-a810-fb1d45a7186a,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap675351e2-f9')
Aug 16 18:13:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No VIF found with MAC fa:16:3e:c8:70:1c, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:13:41 user nova-compute[72000]: DEBUG nova.network.neutron [req-2b51d585-d013-43b1-9f9f-48e132765410 req-af248281-da6f-45b5-8b51-ba5507f10be9 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.neutron [req-2b51d585-d013-43b1-9f9f-48e132765410 req-af248281-da6f-45b5-8b51-ba5507f10be9 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2b51d585-d013-43b1-9f9f-48e132765410 req-af248281-da6f-45b5-8b51-ba5507f10be9 service nova] Releasing lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquired lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:13:42 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Instance destroyed successfully.
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lazy-loading 'resources' on Instance uuid edc29b70-1de4-4824-a0f9-b7be23570630 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:11:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1338479208',display_name='tempest-AttachVolumeTestJSON-server-1338479208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1338479208',id=24,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoFeRHIfNIO8xMvfYptvFjopkPBrgfX32MMTVhZgRm4o5gEn8mbwKBskk7KG8VZzmkGbl9rKQAcnqRkM//gfR1SZA80r1EwHpZYJxdtcaYd5iXJqNvTwDlG3U4Fp1cYNA==',key_name='tempest-keypair-1760269194',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:11:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcae1940950a4007898ba8d8ca6de402',ramdisk_id='',reservation_id='r-q9imu0ee',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-120427729',owner_user_name='tempest-AttachVolumeTestJSON-120427729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:11:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6df288fb86024b8d8a10bb0d0049e499',uuid=edc29b70-1de4-4824-a0f9-b7be23570630,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converting VIF {"id": "c2b2f625-3095-4388-81e3-a180e303b684", "address": "fa:16:3e:48:10:5f", "network": {"id": "18cfc44b-c175-4930-81be-ec80a86fdd44", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1740663526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcae1940950a4007898ba8d8ca6de402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b2f625-30", "ovs_interfaceid": "c2b2f625-3095-4388-81e3-a180e303b684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:10:5f,bridge_name='br-int',has_traffic_filtering=True,id=c2b2f625-3095-4388-81e3-a180e303b684,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b2f625-30') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG os_vif [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:10:5f,bridge_name='br-int',has_traffic_filtering=True,id=c2b2f625-3095-4388-81e3-a180e303b684,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b2f625-30') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2b2f625-30, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:42 user nova-compute[72000]: INFO os_vif [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:10:5f,bridge_name='br-int',has_traffic_filtering=True,id=c2b2f625-3095-4388-81e3-a180e303b684,network=Network(18cfc44b-c175-4930-81be-ec80a86fdd44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b2f625-30')
Aug 16 18:13:42 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Deleting instance files /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630_del
Aug 16 18:13:42 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Deletion of /opt/stack/data/nova/instances/edc29b70-1de4-4824-a0f9-b7be23570630_del complete
Aug 16 18:13:42 user nova-compute[72000]: INFO nova.compute.manager [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 16 18:13:42 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Updating instance_info_cache with network_info: [{"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Releasing lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Instance network_info: |[{"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Start _get_guest_xml network_info=[{"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:13:42 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:13:42 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1240206507',display_name='tempest-TestStampPattern-server-1240206507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1240206507',id=27,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnL9X6wz3GwRD3jGjdqTIwmD/7nKpA3bWQ1ZIEuWHKZC1VpFYkzRFXTP/yQJ9fYNYYuFbJpkSkCeUgHRnAHArKDMODurNq3Vj+iMZJqARRn9GQICSStCAl47V2JXBmY1g==',key_name='tempest-TestStampPattern-2099348715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fe73c2955b4eddbbfd84bd9806ba88',ramdisk_id='',reservation_id='r-36b3u8l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-463262942',owner_user_name='tempest-TestStampPattern-463262942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:13:40Z,user_data=None,user_id='bce14217bd604140a4082ca9f6b862c0',uuid=618b087f-3794-4508-bc46-a30f888525ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converting VIF {"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:b7:01,bridge_name='br-int',has_traffic_filtering=True,id=a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f1b48d-6f') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'pci_devices' on Instance uuid 618b087f-3794-4508-bc46-a30f888525ec {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:13:42 user nova-compute[72000]:   <uuid>618b087f-3794-4508-bc46-a30f888525ec</uuid>
Aug 16 18:13:42 user nova-compute[72000]:   <name>instance-0000001b</name>
Aug 16 18:13:42 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:13:42 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:13:42 user nova-compute[72000]:   <metadata>
Aug 16 18:13:42 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:13:42 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:13:42 user nova-compute[72000]:       <nova:name>tempest-TestStampPattern-server-1240206507</nova:name>
Aug 16 18:13:42 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:13:42</nova:creationTime>
Aug 16 18:13:42 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:13:42 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:13:42 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:13:42 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:13:42 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:13:42 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:13:42 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:13:42 user nova-compute[72000]:       <nova:owner>
Aug 16 18:13:42 user nova-compute[72000]:         <nova:user uuid="bce14217bd604140a4082ca9f6b862c0">tempest-TestStampPattern-463262942-project-member</nova:user>
Aug 16 18:13:42 user nova-compute[72000]:         <nova:project uuid="c6fe73c2955b4eddbbfd84bd9806ba88">tempest-TestStampPattern-463262942</nova:project>
Aug 16 18:13:42 user nova-compute[72000]:       </nova:owner>
Aug 16 18:13:42 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:13:42 user nova-compute[72000]:       <nova:ports>
Aug 16 18:13:42 user nova-compute[72000]:         <nova:port uuid="a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8">
Aug 16 18:13:42 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 18:13:42 user nova-compute[72000]:         </nova:port>
Aug 16 18:13:42 user nova-compute[72000]:       </nova:ports>
Aug 16 18:13:42 user nova-compute[72000]:     </nova:instance>
Aug 16 18:13:42 user nova-compute[72000]:   </metadata>
Aug 16 18:13:42 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:13:42 user nova-compute[72000]:     <system>
Aug 16 18:13:42 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:13:42 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:13:42 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:13:42 user nova-compute[72000]:       <entry name="serial">618b087f-3794-4508-bc46-a30f888525ec</entry>
Aug 16 18:13:42 user nova-compute[72000]:       <entry name="uuid">618b087f-3794-4508-bc46-a30f888525ec</entry>
Aug 16 18:13:42 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:13:42 user nova-compute[72000]:     </system>
Aug 16 18:13:42 user nova-compute[72000]:   </sysinfo>
Aug 16 18:13:42 user nova-compute[72000]:   <os>
Aug 16 18:13:42 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:13:42 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:13:42 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:13:42 user nova-compute[72000]:   </os>
Aug 16 18:13:42 user nova-compute[72000]:   <features>
Aug 16 18:13:42 user nova-compute[72000]:     <acpi/>
Aug 16 18:13:42 user nova-compute[72000]:     <apic/>
Aug 16 18:13:42 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:13:42 user nova-compute[72000]:   </features>
Aug 16 18:13:42 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:13:42 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:13:42 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:13:42 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:13:42 user nova-compute[72000]:   </clock>
Aug 16 18:13:42 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:13:42 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:13:42 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:13:42 user nova-compute[72000]:   </cpu>
Aug 16 18:13:42 user nova-compute[72000]:   <devices>
Aug 16 18:13:42 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:13:42 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:13:42 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk"/>
Aug 16 18:13:42 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:13:42 user nova-compute[72000]:     </disk>
Aug 16 18:13:42 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:13:42 user nova-compute[72000]:       <mac address="fa:16:3e:69:b7:01"/>
Aug 16 18:13:42 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:13:42 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:13:42 user nova-compute[72000]:       <target dev="tapa3f1b48d-6f"/>
Aug 16 18:13:42 user nova-compute[72000]:     </interface>
Aug 16 18:13:42 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:13:42 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/console.log" append="off"/>
Aug 16 18:13:42 user nova-compute[72000]:     </serial>
Aug 16 18:13:42 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:13:42 user nova-compute[72000]:     <video>
Aug 16 18:13:42 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:13:42 user nova-compute[72000]:     </video>
Aug 16 18:13:42 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:13:42 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:13:42 user nova-compute[72000]:     </rng>
Aug 16 18:13:42 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:13:42 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:13:42 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:13:42 user nova-compute[72000]:     </memballoon>
Aug 16 18:13:42 user nova-compute[72000]:   </devices>
Aug 16 18:13:42 user nova-compute[72000]: </domain>
Aug 16 18:13:42 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1240206507',display_name='tempest-TestStampPattern-server-1240206507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1240206507',id=27,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnL9X6wz3GwRD3jGjdqTIwmD/7nKpA3bWQ1ZIEuWHKZC1VpFYkzRFXTP/yQJ9fYNYYuFbJpkSkCeUgHRnAHArKDMODurNq3Vj+iMZJqARRn9GQICSStCAl47V2JXBmY1g==',key_name='tempest-TestStampPattern-2099348715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fe73c2955b4eddbbfd84bd9806ba88',ramdisk_id='',reservation_id='r-36b3u8l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-463262942',owner_user_name='tempest-TestStampPattern-463262942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:13:40Z,user_data=None,user_id='bce14217bd604140a4082ca9f6b862c0',uuid=618b087f-3794-4508-bc46-a30f888525ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converting VIF {"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:b7:01,bridge_name='br-int',has_traffic_filtering=True,id=a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f1b48d-6f') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG os_vif [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:b7:01,bridge_name='br-int',has_traffic_filtering=True,id=a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f1b48d-6f') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3f1b48d-6f, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3f1b48d-6f, col_values=(('external_ids', {'iface-id': 'a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:b7:01', 'vm-uuid': '618b087f-3794-4508-bc46-a30f888525ec'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:42 user nova-compute[72000]: INFO os_vif [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:b7:01,bridge_name='br-int',has_traffic_filtering=True,id=a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f1b48d-6f')
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:13:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] No VIF found with MAC fa:16:3e:69:b7:01, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received event network-vif-unplugged-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] Lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] Lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] No waiting events found dispatching network-vif-unplugged-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received event network-vif-unplugged-c2b2f625-3095-4388-81e3-a180e303b684 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received event network-vif-plugged-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] Acquiring lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] Lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] Lock "edc29b70-1de4-4824-a0f9-b7be23570630-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] No waiting events found dispatching network-vif-plugged-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:13:43 user nova-compute[72000]: WARNING nova.compute.manager [req-a502fc84-52c1-444d-b1b6-739d0a908a7e req-48776176-a504-4e34-aaae-912ea29d7cb4 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received unexpected event network-vif-plugged-c2b2f625-3095-4388-81e3-a180e303b684 for instance with vm_state active and task_state deleting.
Aug 16 18:13:43 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Took 1.19 seconds to deallocate network for instance.
Aug 16 18:13:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-cec7870b-c0bc-4a45-b8d4-5d767f63b3b3 req-720ce0cc-af51-4f6f-b3d8-f366e66b2f73 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Received event network-vif-deleted-c2b2f625-3095-4388-81e3-a180e303b684 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:43 user nova-compute[72000]: INFO nova.compute.manager [req-cec7870b-c0bc-4a45-b8d4-5d767f63b3b3 req-720ce0cc-af51-4f6f-b3d8-f366e66b2f73 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Neutron deleted interface c2b2f625-3095-4388-81e3-a180e303b684; detaching it from the instance and deleting it from the info cache
Aug 16 18:13:43 user nova-compute[72000]: DEBUG nova.network.neutron [req-cec7870b-c0bc-4a45-b8d4-5d767f63b3b3 req-720ce0cc-af51-4f6f-b3d8-f366e66b2f73 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-cec7870b-c0bc-4a45-b8d4-5d767f63b3b3 req-720ce0cc-af51-4f6f-b3d8-f366e66b2f73 service nova] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Detach interface failed, port_id=c2b2f625-3095-4388-81e3-a180e303b684, reason: Instance edc29b70-1de4-4824-a0f9-b7be23570630 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:44 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:13:44 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:13:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:44 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Deleted allocations for instance edc29b70-1de4-4824-a0f9-b7be23570630
Aug 16 18:13:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5efc5dac-e867-4fc2-a152-ef63168701d1 tempest-AttachVolumeTestJSON-120427729 tempest-AttachVolumeTestJSON-120427729-project-member] Lock "edc29b70-1de4-4824-a0f9-b7be23570630" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.995s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:13:45 user nova-compute[72000]: WARNING nova.compute.manager [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state building and task_state spawning.
Aug 16 18:13:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:13:45 user nova-compute[72000]: WARNING nova.compute.manager [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state building and task_state spawning.
Aug 16 18:13:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received event network-vif-plugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] Lock "618b087f-3794-4508-bc46-a30f888525ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] Lock "618b087f-3794-4508-bc46-a30f888525ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] No waiting events found dispatching network-vif-plugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:13:45 user nova-compute[72000]: WARNING nova.compute.manager [req-800a4cb7-b03b-4273-9c09-75e2a09af3df req-e6464b63-b19e-4967-b628-44a652fc9a37 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received unexpected event network-vif-plugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 for instance with vm_state building and task_state spawning.
Aug 16 18:13:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209627.5381107, bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] VM Resumed (Lifecycle Event)
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Instance spawned successfully.
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Instance spawned successfully.
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209627.547799, bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] VM Started (Lifecycle Event)
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209627.5561144, 618b087f-3794-4508-bc46-a30f888525ec => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] VM Resumed (Lifecycle Event)
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Took 9.22 seconds to spawn the instance on the hypervisor.
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Took 7.78 seconds to spawn the instance on the hypervisor.
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209627.5580075, 618b087f-3794-4508-bc46-a30f888525ec => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] VM Started (Lifecycle Event)
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Took 8.65 seconds to build instance.
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:13:47 user nova-compute[72000]: INFO nova.compute.manager [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Took 10.33 seconds to build instance.
Aug 16 18:13:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a4c0b1d-6e32-4ef2-be81-c50290137f70 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.759s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e83dac00-6fa7-4e94-91b4-87caa99089c5 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.513s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-abf83abd-5d73-4f04-a2dc-387e854cfff6 req-0623d001-5827-4215-925f-9babdb32379a service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received event network-vif-plugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-abf83abd-5d73-4f04-a2dc-387e854cfff6 req-0623d001-5827-4215-925f-9babdb32379a service nova] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-abf83abd-5d73-4f04-a2dc-387e854cfff6 req-0623d001-5827-4215-925f-9babdb32379a service nova] Lock "618b087f-3794-4508-bc46-a30f888525ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-abf83abd-5d73-4f04-a2dc-387e854cfff6 req-0623d001-5827-4215-925f-9babdb32379a service nova] Lock "618b087f-3794-4508-bc46-a30f888525ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:13:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-abf83abd-5d73-4f04-a2dc-387e854cfff6 req-0623d001-5827-4215-925f-9babdb32379a service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] No waiting events found dispatching network-vif-plugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:13:47 user nova-compute[72000]: WARNING nova.compute.manager [req-abf83abd-5d73-4f04-a2dc-387e854cfff6 req-0623d001-5827-4215-925f-9babdb32379a service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received unexpected event network-vif-plugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 for instance with vm_state active and task_state None.
Aug 16 18:13:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:57 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209622.455171, edc29b70-1de4-4824-a0f9-b7be23570630 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:13:57 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] VM Stopped (Lifecycle Event)
Aug 16 18:13:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-419da26d-c259-4678-8c0d-eaf2f3fae339 None None] [instance: edc29b70-1de4-4824-a0f9-b7be23570630] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:13:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:13:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:14:01 user nova-compute[72000]: INFO nova.compute.claims [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Claim successful on node user
Aug 16 18:14:01 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:14:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:14:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG nova.policy [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '135d5cc19e204a448036340be3ad519a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7b0883d8fa04d16ba310cd8ce6dbaa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:14:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Creating image(s)
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "/opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "/opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "/opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.202s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:14:02 user nova-compute[72000]: INFO nova.compute.claims [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Claim successful on node user
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk 1073741824" returned: 0 in 0.055s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Successfully created port: 8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Cannot resize image /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.objects.instance [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'migration_context' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Ensure instance console log exists: /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:14:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.policy [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de8918c0e1224d8d8881df55de978103', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07547c2b586949039549edd8518edd87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:14:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Creating image(s)
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "/opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "/opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "/opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Successfully updated port: 8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-bc7368b0-718b-4692-b5dd-f9c0b8ed5436 req-0f259473-79b4-4029-984e-2468491f8624 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-changed-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-bc7368b0-718b-4692-b5dd-f9c0b8ed5436 req-0f259473-79b4-4029-984e-2468491f8624 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Refreshing instance network info cache due to event network-changed-8a0ca71d-a462-47fa-85e8-6c689315db09. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bc7368b0-718b-4692-b5dd-f9c0b8ed5436 req-0f259473-79b4-4029-984e-2468491f8624 service nova] Acquiring lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bc7368b0-718b-4692-b5dd-f9c0b8ed5436 req-0f259473-79b4-4029-984e-2468491f8624 service nova] Acquired lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-bc7368b0-718b-4692-b5dd-f9c0b8ed5436 req-0f259473-79b4-4029-984e-2468491f8624 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Refreshing network info cache for port 8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk 1073741824" returned: 0 in 0.074s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-bc7368b0-718b-4692-b5dd-f9c0b8ed5436 req-0f259473-79b4-4029-984e-2468491f8624 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Successfully created port: 83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-bc7368b0-718b-4692-b5dd-f9c0b8ed5436 req-0f259473-79b4-4029-984e-2468491f8624 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bc7368b0-718b-4692-b5dd-f9c0b8ed5436 req-0f259473-79b4-4029-984e-2468491f8624 service nova] Releasing lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquired lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Cannot resize image /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lazy-loading 'migration_context' on Instance uuid 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Ensure instance console log exists: /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updating instance_info_cache with network_info: [{"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Releasing lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance network_info: |[{"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Start _get_guest_xml network_info=[{"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:14:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:14:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760819973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760819973',id=28,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL49CVt0Uq3olYK6lvp81M2OQr9EqGjZdkLgJJ/s+UcDWuE8BakkFDT59JWIXrQxn0Heygnh4BjsCmzFS1CDTkv9tenYbDAE3rcHIAIOvWaVWE7hH35uLXG71q+MS9xu2Q==',key_name='tempest-keypair-562308264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-jnf2nb8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.objects.instance [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'pci_devices' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:14:04 user nova-compute[72000]:   <uuid>98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34</uuid>
Aug 16 18:14:04 user nova-compute[72000]:   <name>instance-0000001c</name>
Aug 16 18:14:04 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:14:04 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:14:04 user nova-compute[72000]:   <metadata>
Aug 16 18:14:04 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:14:04 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:14:04 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-760819973</nova:name>
Aug 16 18:14:04 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:14:04</nova:creationTime>
Aug 16 18:14:04 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:14:04 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:14:04 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:14:04 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:14:04 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:14:04 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:14:04 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:14:04 user nova-compute[72000]:       <nova:owner>
Aug 16 18:14:04 user nova-compute[72000]:         <nova:user uuid="135d5cc19e204a448036340be3ad519a">tempest-AttachVolumeShelveTestJSON-1660838105-project-member</nova:user>
Aug 16 18:14:04 user nova-compute[72000]:         <nova:project uuid="c7b0883d8fa04d16ba310cd8ce6dbaa4">tempest-AttachVolumeShelveTestJSON-1660838105</nova:project>
Aug 16 18:14:04 user nova-compute[72000]:       </nova:owner>
Aug 16 18:14:04 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:14:04 user nova-compute[72000]:       <nova:ports>
Aug 16 18:14:04 user nova-compute[72000]:         <nova:port uuid="8a0ca71d-a462-47fa-85e8-6c689315db09">
Aug 16 18:14:04 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 18:14:04 user nova-compute[72000]:         </nova:port>
Aug 16 18:14:04 user nova-compute[72000]:       </nova:ports>
Aug 16 18:14:04 user nova-compute[72000]:     </nova:instance>
Aug 16 18:14:04 user nova-compute[72000]:   </metadata>
Aug 16 18:14:04 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:14:04 user nova-compute[72000]:     <system>
Aug 16 18:14:04 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:14:04 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:14:04 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:14:04 user nova-compute[72000]:       <entry name="serial">98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34</entry>
Aug 16 18:14:04 user nova-compute[72000]:       <entry name="uuid">98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34</entry>
Aug 16 18:14:04 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:14:04 user nova-compute[72000]:     </system>
Aug 16 18:14:04 user nova-compute[72000]:   </sysinfo>
Aug 16 18:14:04 user nova-compute[72000]:   <os>
Aug 16 18:14:04 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:14:04 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:14:04 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:14:04 user nova-compute[72000]:   </os>
Aug 16 18:14:04 user nova-compute[72000]:   <features>
Aug 16 18:14:04 user nova-compute[72000]:     <acpi/>
Aug 16 18:14:04 user nova-compute[72000]:     <apic/>
Aug 16 18:14:04 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:14:04 user nova-compute[72000]:   </features>
Aug 16 18:14:04 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:14:04 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:14:04 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:14:04 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:14:04 user nova-compute[72000]:   </clock>
Aug 16 18:14:04 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:14:04 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:14:04 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:14:04 user nova-compute[72000]:   </cpu>
Aug 16 18:14:04 user nova-compute[72000]:   <devices>
Aug 16 18:14:04 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:14:04 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:14:04 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk"/>
Aug 16 18:14:04 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:14:04 user nova-compute[72000]:     </disk>
Aug 16 18:14:04 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:14:04 user nova-compute[72000]:       <mac address="fa:16:3e:18:74:ba"/>
Aug 16 18:14:04 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:14:04 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:14:04 user nova-compute[72000]:       <target dev="tap8a0ca71d-a4"/>
Aug 16 18:14:04 user nova-compute[72000]:     </interface>
Aug 16 18:14:04 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:14:04 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/console.log" append="off"/>
Aug 16 18:14:04 user nova-compute[72000]:     </serial>
Aug 16 18:14:04 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:14:04 user nova-compute[72000]:     <video>
Aug 16 18:14:04 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:14:04 user nova-compute[72000]:     </video>
Aug 16 18:14:04 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:14:04 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:14:04 user nova-compute[72000]:     </rng>
Aug 16 18:14:04 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:14:04 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:14:04 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:14:04 user nova-compute[72000]:     </memballoon>
Aug 16 18:14:04 user nova-compute[72000]:   </devices>
Aug 16 18:14:04 user nova-compute[72000]: </domain>
Aug 16 18:14:04 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760819973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760819973',id=28,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL49CVt0Uq3olYK6lvp81M2OQr9EqGjZdkLgJJ/s+UcDWuE8BakkFDT59JWIXrQxn0Heygnh4BjsCmzFS1CDTkv9tenYbDAE3rcHIAIOvWaVWE7hH35uLXG71q+MS9xu2Q==',key_name='tempest-keypair-562308264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-jnf2nb8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG os_vif [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a0ca71d-a4, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a0ca71d-a4, col_values=(('external_ids', {'iface-id': '8a0ca71d-a462-47fa-85e8-6c689315db09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:74:ba', 'vm-uuid': '98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:04 user nova-compute[72000]: INFO os_vif [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4')
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] No VIF found with MAC fa:16:3e:18:74:ba, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Successfully updated port: 83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "refresh_cache-04c75ec7-92c4-4130-8846-e867dd5384c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquired lock "refresh_cache-04c75ec7-92c4-4130-8846-e867dd5384c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-53af9425-6626-4afa-be98-e02066b766d1 req-12d2e30b-f9de-42cd-9b6b-39ce94adab26 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received event network-changed-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-53af9425-6626-4afa-be98-e02066b766d1 req-12d2e30b-f9de-42cd-9b6b-39ce94adab26 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Refreshing instance network info cache due to event network-changed-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-53af9425-6626-4afa-be98-e02066b766d1 req-12d2e30b-f9de-42cd-9b6b-39ce94adab26 service nova] Acquiring lock "refresh_cache-04c75ec7-92c4-4130-8846-e867dd5384c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Updating instance_info_cache with network_info: [{"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Releasing lock "refresh_cache-04c75ec7-92c4-4130-8846-e867dd5384c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Instance network_info: |[{"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-53af9425-6626-4afa-be98-e02066b766d1 req-12d2e30b-f9de-42cd-9b6b-39ce94adab26 service nova] Acquired lock "refresh_cache-04c75ec7-92c4-4130-8846-e867dd5384c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.neutron [req-53af9425-6626-4afa-be98-e02066b766d1 req-12d2e30b-f9de-42cd-9b6b-39ce94adab26 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Refreshing network info cache for port 83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Start _get_guest_xml network_info=[{"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:14:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:14:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:14:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1944849135',display_name='tempest-TestServerVolumeAttachmentScenario-server-1944849135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1944849135',id=29,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBGFAfIRAXUVCacVwex1FCtD7ZI5uv8FGqj9O2FlWTsOWVU7OLNxA8IuQXcNOkI9A+jzT5h1VEYPzN6FCg/zRBbiisG/u6dCyrzgPSoGUplyTn6xPaWpsv4Af1JoQJkCA==',key_name='tempest-keypair-1689008237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07547c2b586949039549edd8518edd87',ramdisk_id='',reservation_id='r-qgdc7t7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1450812033',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1450812033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:14:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de8918c0e1224d8d8881df55de978103',uuid=04c75ec7-92c4-4130-8846-e867dd5384c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Converting VIF {"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:22,bridge_name='br-int',has_traffic_filtering=True,id=83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae,network=Network(39774ec0-e19d-4867-ab51-0219e522b77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e3b8c5-cd') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:14:04 user nova-compute[72000]: DEBUG nova.objects.instance [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lazy-loading 'pci_devices' on Instance uuid 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:14:05 user nova-compute[72000]:   <uuid>04c75ec7-92c4-4130-8846-e867dd5384c4</uuid>
Aug 16 18:14:05 user nova-compute[72000]:   <name>instance-0000001d</name>
Aug 16 18:14:05 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:14:05 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:14:05 user nova-compute[72000]:   <metadata>
Aug 16 18:14:05 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:14:05 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:14:05 user nova-compute[72000]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1944849135</nova:name>
Aug 16 18:14:05 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:14:04</nova:creationTime>
Aug 16 18:14:05 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:14:05 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:14:05 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:14:05 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:14:05 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:14:05 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:14:05 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:14:05 user nova-compute[72000]:       <nova:owner>
Aug 16 18:14:05 user nova-compute[72000]:         <nova:user uuid="de8918c0e1224d8d8881df55de978103">tempest-TestServerVolumeAttachmentScenario-1450812033-project-member</nova:user>
Aug 16 18:14:05 user nova-compute[72000]:         <nova:project uuid="07547c2b586949039549edd8518edd87">tempest-TestServerVolumeAttachmentScenario-1450812033</nova:project>
Aug 16 18:14:05 user nova-compute[72000]:       </nova:owner>
Aug 16 18:14:05 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:14:05 user nova-compute[72000]:       <nova:ports>
Aug 16 18:14:05 user nova-compute[72000]:         <nova:port uuid="83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae">
Aug 16 18:14:05 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 18:14:05 user nova-compute[72000]:         </nova:port>
Aug 16 18:14:05 user nova-compute[72000]:       </nova:ports>
Aug 16 18:14:05 user nova-compute[72000]:     </nova:instance>
Aug 16 18:14:05 user nova-compute[72000]:   </metadata>
Aug 16 18:14:05 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:14:05 user nova-compute[72000]:     <system>
Aug 16 18:14:05 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:14:05 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:14:05 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:14:05 user nova-compute[72000]:       <entry name="serial">04c75ec7-92c4-4130-8846-e867dd5384c4</entry>
Aug 16 18:14:05 user nova-compute[72000]:       <entry name="uuid">04c75ec7-92c4-4130-8846-e867dd5384c4</entry>
Aug 16 18:14:05 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:14:05 user nova-compute[72000]:     </system>
Aug 16 18:14:05 user nova-compute[72000]:   </sysinfo>
Aug 16 18:14:05 user nova-compute[72000]:   <os>
Aug 16 18:14:05 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:14:05 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:14:05 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:14:05 user nova-compute[72000]:   </os>
Aug 16 18:14:05 user nova-compute[72000]:   <features>
Aug 16 18:14:05 user nova-compute[72000]:     <acpi/>
Aug 16 18:14:05 user nova-compute[72000]:     <apic/>
Aug 16 18:14:05 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:14:05 user nova-compute[72000]:   </features>
Aug 16 18:14:05 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:14:05 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:14:05 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:14:05 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:14:05 user nova-compute[72000]:   </clock>
Aug 16 18:14:05 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:14:05 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:14:05 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:14:05 user nova-compute[72000]:   </cpu>
Aug 16 18:14:05 user nova-compute[72000]:   <devices>
Aug 16 18:14:05 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:14:05 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:14:05 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk"/>
Aug 16 18:14:05 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:14:05 user nova-compute[72000]:     </disk>
Aug 16 18:14:05 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:14:05 user nova-compute[72000]:       <mac address="fa:16:3e:14:4e:22"/>
Aug 16 18:14:05 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:14:05 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:14:05 user nova-compute[72000]:       <target dev="tap83e3b8c5-cd"/>
Aug 16 18:14:05 user nova-compute[72000]:     </interface>
Aug 16 18:14:05 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:14:05 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/console.log" append="off"/>
Aug 16 18:14:05 user nova-compute[72000]:     </serial>
Aug 16 18:14:05 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:14:05 user nova-compute[72000]:     <video>
Aug 16 18:14:05 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:14:05 user nova-compute[72000]:     </video>
Aug 16 18:14:05 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:14:05 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:14:05 user nova-compute[72000]:     </rng>
Aug 16 18:14:05 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:14:05 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:14:05 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:14:05 user nova-compute[72000]:     </memballoon>
Aug 16 18:14:05 user nova-compute[72000]:   </devices>
Aug 16 18:14:05 user nova-compute[72000]: </domain>
Aug 16 18:14:05 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:14:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1944849135',display_name='tempest-TestServerVolumeAttachmentScenario-server-1944849135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1944849135',id=29,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBGFAfIRAXUVCacVwex1FCtD7ZI5uv8FGqj9O2FlWTsOWVU7OLNxA8IuQXcNOkI9A+jzT5h1VEYPzN6FCg/zRBbiisG/u6dCyrzgPSoGUplyTn6xPaWpsv4Af1JoQJkCA==',key_name='tempest-keypair-1689008237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07547c2b586949039549edd8518edd87',ramdisk_id='',reservation_id='r-qgdc7t7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1450812033',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1450812033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:14:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de8918c0e1224d8d8881df55de978103',uuid=04c75ec7-92c4-4130-8846-e867dd5384c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Converting VIF {"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:22,bridge_name='br-int',has_traffic_filtering=True,id=83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae,network=Network(39774ec0-e19d-4867-ab51-0219e522b77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e3b8c5-cd') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG os_vif [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:22,bridge_name='br-int',has_traffic_filtering=True,id=83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae,network=Network(39774ec0-e19d-4867-ab51-0219e522b77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e3b8c5-cd') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83e3b8c5-cd, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83e3b8c5-cd, col_values=(('external_ids', {'iface-id': '83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:4e:22', 'vm-uuid': '04c75ec7-92c4-4130-8846-e867dd5384c4'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:05 user nova-compute[72000]: INFO os_vif [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4e:22,bridge_name='br-int',has_traffic_filtering=True,id=83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae,network=Network(39774ec0-e19d-4867-ab51-0219e522b77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e3b8c5-cd')
Aug 16 18:14:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] No VIF found with MAC fa:16:3e:14:4e:22, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG nova.network.neutron [req-53af9425-6626-4afa-be98-e02066b766d1 req-12d2e30b-f9de-42cd-9b6b-39ce94adab26 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Updated VIF entry in instance network info cache for port 83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG nova.network.neutron [req-53af9425-6626-4afa-be98-e02066b766d1 req-12d2e30b-f9de-42cd-9b6b-39ce94adab26 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Updating instance_info_cache with network_info: [{"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-53af9425-6626-4afa-be98-e02066b766d1 req-12d2e30b-f9de-42cd-9b6b-39ce94adab26 service nova] Releasing lock "refresh_cache-04c75ec7-92c4-4130-8846-e867dd5384c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-c8448e6a-2595-415a-ba55-1c66871aed14 req-d639458c-5adf-4184-b1ef-42d5df941fab service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c8448e6a-2595-415a-ba55-1c66871aed14 req-d639458c-5adf-4184-b1ef-42d5df941fab service nova] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c8448e6a-2595-415a-ba55-1c66871aed14 req-d639458c-5adf-4184-b1ef-42d5df941fab service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c8448e6a-2595-415a-ba55-1c66871aed14 req-d639458c-5adf-4184-b1ef-42d5df941fab service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-c8448e6a-2595-415a-ba55-1c66871aed14 req-d639458c-5adf-4184-b1ef-42d5df941fab service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] No waiting events found dispatching network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:14:06 user nova-compute[72000]: WARNING nova.compute.manager [req-c8448e6a-2595-415a-ba55-1c66871aed14 req-d639458c-5adf-4184-b1ef-42d5df941fab service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received unexpected event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 for instance with vm_state building and task_state spawning.
Aug 16 18:14:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] No waiting events found dispatching network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:14:08 user nova-compute[72000]: WARNING nova.compute.manager [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received unexpected event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 for instance with vm_state building and task_state spawning.
Aug 16 18:14:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received event network-vif-plugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] No waiting events found dispatching network-vif-plugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:14:08 user nova-compute[72000]: WARNING nova.compute.manager [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received unexpected event network-vif-plugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae for instance with vm_state building and task_state spawning.
Aug 16 18:14:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received event network-vif-plugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] No waiting events found dispatching network-vif-plugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:14:08 user nova-compute[72000]: WARNING nova.compute.manager [req-e7429c52-e6ce-4dda-8f75-2f4a25d5af90 req-557f0b6b-d7c1-4fd1-90ab-fabde7785b97 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received unexpected event network-vif-plugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae for instance with vm_state building and task_state spawning.
Aug 16 18:14:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209649.3214087, 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] VM Resumed (Lifecycle Event)
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance spawned successfully.
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209649.3228433, 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] VM Started (Lifecycle Event)
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209649.4371696, 04c75ec7-92c4-4130-8846-e867dd5384c4 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] VM Resumed (Lifecycle Event)
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Instance spawned successfully.
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Took 7.73 seconds to spawn the instance on the hypervisor.
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209649.437417, 04c75ec7-92c4-4130-8846-e867dd5384c4 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] VM Started (Lifecycle Event)
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Took 6.73 seconds to spawn the instance on the hypervisor.
Aug 16 18:14:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Took 8.52 seconds to build instance.
Aug 16 18:14:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-07a1fbf9-b2bf-4209-911a-4bf9454e398c tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.647s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:09 user nova-compute[72000]: INFO nova.compute.manager [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Took 7.57 seconds to build instance.
Aug 16 18:14:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdde1ff3-ac1a-4a0d-b887-44fb7413e8de tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.717s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:14:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:14:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:14:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:14:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:14:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:14:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:14:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:14:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:14:21 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:14:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:14:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:14:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:14:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:14:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:14:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:14:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:14:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:14:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:14:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:25 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:14:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:29 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:14:29 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:14:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7328MB free_disk=23.713356018066406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:14:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 89561a1c-6fae-4ded-865b-d338e86e40d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 618b087f-3794-4508-bc46-a30f888525ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 04c75ec7-92c4-4130-8846-e867dd5384c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:14:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-666865ce-a639-43c4-9b63-0ccde18b893d req-2991e718-c2a2-417c-ad6d-fc28b0ab0d66 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received event network-changed-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-666865ce-a639-43c4-9b63-0ccde18b893d req-2991e718-c2a2-417c-ad6d-fc28b0ab0d66 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Refreshing instance network info cache due to event network-changed-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:14:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-666865ce-a639-43c4-9b63-0ccde18b893d req-2991e718-c2a2-417c-ad6d-fc28b0ab0d66 service nova] Acquiring lock "refresh_cache-89561a1c-6fae-4ded-865b-d338e86e40d8" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:14:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-666865ce-a639-43c4-9b63-0ccde18b893d req-2991e718-c2a2-417c-ad6d-fc28b0ab0d66 service nova] Acquired lock "refresh_cache-89561a1c-6fae-4ded-865b-d338e86e40d8" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:14:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-666865ce-a639-43c4-9b63-0ccde18b893d req-2991e718-c2a2-417c-ad6d-fc28b0ab0d66 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Refreshing network info cache for port 68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:14:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "89561a1c-6fae-4ded-865b-d338e86e40d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:34 user nova-compute[72000]: DEBUG nova.objects.instance [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'flavor' on Instance uuid 89561a1c-6fae-4ded-865b-d338e86e40d8 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:34 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Ignoring supplied device name: /dev/vdb
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "89561a1c-6fae-4ded-865b-d338e86e40d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:35 user nova-compute[72000]: INFO nova.compute.manager [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Attaching volume 2d800661-1e92-40da-955e-38d055ff1afc to /dev/vdb
Aug 16 18:14:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-666865ce-a639-43c4-9b63-0ccde18b893d req-2991e718-c2a2-417c-ad6d-fc28b0ab0d66 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Updated VIF entry in instance network info cache for port 68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-666865ce-a639-43c4-9b63-0ccde18b893d req-2991e718-c2a2-417c-ad6d-fc28b0ab0d66 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Updating instance_info_cache with network_info: [{"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-666865ce-a639-43c4-9b63-0ccde18b893d req-2991e718-c2a2-417c-ad6d-fc28b0ab0d66 service nova] Releasing lock "refresh_cache-89561a1c-6fae-4ded-865b-d338e86e40d8" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.utils [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eb7140-1b6a-4aa3-9dc4-e744d5089132]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9860ce1a-ed21-49bd-b75a-7fec0ba825bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd8588f-9ce2-4eee-a062-a4f30887f96a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0931e4d3-6336-40a7-a2fa-c105c048c610]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:14:35 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[49da2d25-6e69-445e-b11c-27116b78953c]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.utils [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Updating existing volume attachment record: b75a9fcf-a935-4d18-bbf7-995cd8127c6a {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'flavor' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:35 user nova-compute[72000]: INFO nova.compute.manager [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Attaching volume d404e6a3-3dc4-41ac-b92d-4cbffca77a1b to /dev/vdb
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.utils [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed01d177-3129-412b-b422-c5f50ff6c6cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab34fe1-98ea-4a03-8718-4c16a183afaf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[29045b35-1f0d-4867-9307-d72f831a2803]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c463a22-7062-4c7d-95ac-39f5ab6e3c83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:14:35 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:14:35 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e5cc58-1c07-46cd-a487-2522282e31f6]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG os_brick.utils [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:14:35 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updating existing volume attachment record: 57465f8b-29e5-49af-9be8-c1b2aa2185b0 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:14:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIqityk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:14:45 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:14:45 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:14:45 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec3643b-f6aa-40be-a777-0a5777467299]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:14:45 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6439404e-4220-4e84-9987-a723ca54f4cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc] added
Aug 16 18:14:45 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21793edc-31a2-4dec-aafd-457b56572f72]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[28201e56-8991-4660-8a88-3c521789e5e6]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANIqityk {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANIqityk" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[881fa017-9588-49c7-9041-56c0a2534ccc]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANIqityk'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a54ef65-075f-4128-ac25-116ed8ce4c0f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f766a437-a50f-4359-9754-9719e175745a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:14:46 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:14:46 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:14:46 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 18:14:46 user nova-compute[72000]: 
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3038f531-8c84-4c4d-b6dd-573247196104]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc, portal: 172.16.0.220,3260]
Aug 16 18:14:46 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc, portal: 172.16.0.220,3260] successful.
Aug 16 18:14:46 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[857e2fb0-3654-476b-8271-91da2154f1e9]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3912c6-fe50-496f-957d-6d1ea9e54264]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)
Aug 16 18:14:46 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)
Aug 16 18:14:46 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[811279be-2dd0-4618-86aa-a3822f191b70]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xslSweYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:14:46 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:14:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIqityk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26233336166653863', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233336166653863', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.948s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:14:47 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:14:47 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG nova.objects.instance [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'flavor' on Instance uuid 89561a1c-6fae-4ded-865b-d338e86e40d8 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec0294f-b950-4c9d-b1a6-2e7cf30061b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:14:47 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:14:47 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:14:47 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:14:47 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:14:47 user nova-compute[72000]:   <serial>2d800661-1e92-40da-955e-38d055ff1afc</serial>
Aug 16 18:14:47 user nova-compute[72000]: </disk>
Aug 16 18:14:47 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[740e4334-11b0-476b-bffb-336831ad1882]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b] added
Aug 16 18:14:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c99a01-38b6-41ff-930b-9454c97ce627]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f04e1c-ffac-460e-8472-e180e3af2be2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xslSweYi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xslSweYi" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fff07c-30a6-4258-84fc-b282c0a4c9d5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xslSweYi'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fda0cb-1a3c-4bc7-94cb-cf6438a9d6fe]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faad30c-123a-491d-8819-804838d7e6f7]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)
Aug 16 18:14:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)
Aug 16 18:14:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e7469f-5783-4cfb-8e2f-945918f25f67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b, portal: 172.16.0.220,3260]
Aug 16 18:14:47 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b, portal: 172.16.0.220,3260] successful.
Aug 16 18:14:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3743222d-22f7-4220-85c1-5ff3783c4095]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb5b884-256f-44a9-a48b-cf31b2ea8623]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)
Aug 16 18:14:47 user nova-compute[72000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:14:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)
Aug 16 18:14:47 user nova-compute[72000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:14:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[facf2a83-626b-462b-963e-0282577d505a]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xslSweYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] No VIF found with MAC fa:16:3e:99:83:dc, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:14:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-e5cee40d-a0aa-465b-80d0-8e17c2fcdf70 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.627s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:14:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] <== connect_volume: return (2281ms) {'type': 'block', 'scsi_wwn': '23165356431636465', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:14:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165356431636465', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:14:48 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'flavor' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:14:48 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:14:48 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:14:48 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:14:48 user nova-compute[72000]:   <serial>d404e6a3-3dc4-41ac-b92d-4cbffca77a1b</serial>
Aug 16 18:14:48 user nova-compute[72000]: </disk>
Aug 16 18:14:48 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:14:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:14:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:14:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] No VIF found with MAC fa:16:3e:02:5e:ea, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:14:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5ca541ec-da52-40fa-b1b1-5cc62c19359b tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.573s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:49 user nova-compute[72000]: INFO nova.compute.manager [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Rescuing
Aug 16 18:14:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:14:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquired lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:14:49 user nova-compute[72000]: DEBUG nova.network.neutron [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updating instance_info_cache with network_info: [{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Releasing lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-f2c881c0-ce33-4a51-9e03-e31cff918849 req-0f5b4822-b849-474d-9066-680fc4739204 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-unplugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f2c881c0-ce33-4a51-9e03-e31cff918849 req-0f5b4822-b849-474d-9066-680fc4739204 service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f2c881c0-ce33-4a51-9e03-e31cff918849 req-0f5b4822-b849-474d-9066-680fc4739204 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f2c881c0-ce33-4a51-9e03-e31cff918849 req-0f5b4822-b849-474d-9066-680fc4739204 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-f2c881c0-ce33-4a51-9e03-e31cff918849 req-0f5b4822-b849-474d-9066-680fc4739204 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-unplugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:14:50 user nova-compute[72000]: WARNING nova.compute.manager [req-f2c881c0-ce33-4a51-9e03-e31cff918849 req-0f5b4822-b849-474d-9066-680fc4739204 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-unplugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state active and task_state rescuing.
Aug 16 18:14:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Instance destroyed successfully.
Aug 16 18:14:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Attempting a stable device rescue
Aug 16 18:14:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 18:14:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Instance directory exists: not creating {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 18:14:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Creating image(s)
Aug 16 18:14:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:51 user nova-compute[72000]: DEBUG nova.objects.instance [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'trusted_certs' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "5d3f9411387e6c499fb9399d696d5d90f14fee69" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "5d3f9411387e6c499fb9399d696d5d90f14fee69" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69.part --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69.part --force-share --output=json" returned: 0 in 0.172s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG nova.virt.images [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] 16750a30-bbe3-41d4-96e8-7fb3c878f0c0 was qcow2, converting to raw {{(pid=72000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69.part /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69.converted {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69.part /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69.converted" returned: 0 in 0.302s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69.converted --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-524e8d77-364d-43e0-b8a1-6eb28bc66db1 req-86bc5d6c-9229-4cb2-b4a5-532c97261bcc service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-524e8d77-364d-43e0-b8a1-6eb28bc66db1 req-86bc5d6c-9229-4cb2-b4a5-532c97261bcc service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-524e8d77-364d-43e0-b8a1-6eb28bc66db1 req-86bc5d6c-9229-4cb2-b4a5-532c97261bcc service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-524e8d77-364d-43e0-b8a1-6eb28bc66db1 req-86bc5d6c-9229-4cb2-b4a5-532c97261bcc service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-524e8d77-364d-43e0-b8a1-6eb28bc66db1 req-86bc5d6c-9229-4cb2-b4a5-532c97261bcc service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:14:52 user nova-compute[72000]: WARNING nova.compute.manager [req-524e8d77-364d-43e0-b8a1-6eb28bc66db1 req-86bc5d6c-9229-4cb2-b4a5-532c97261bcc service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state active and task_state rescuing.
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "5d3f9411387e6c499fb9399d696d5d90f14fee69" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.545s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "5d3f9411387e6c499fb9399d696d5d90f14fee69" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "5d3f9411387e6c499fb9399d696d5d90f14fee69" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69 --force-share --output=json" returned: 0 in 0.217s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69,backing_fmt=raw /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69,backing_fmt=raw /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue" returned: 0 in 0.047s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "5d3f9411387e6c499fb9399d696d5d90f14fee69" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'migration_context' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Start _get_guest_xml network_info=[{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "vif_mac": "fa:16:3e:02:5e:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '16750a30-bbe3-41d4-96e8-7fb3c878f0c0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xslSweYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '59b456c9-e5af-4e47-a2f1-ba4f35c8308a', 'attached_at': '', 'detached_at': '', 'volume_id': 'd404e6a3-3dc4-41ac-b92d-4cbffca77a1b', 'serial': 'd404e6a3-3dc4-41ac-b92d-4cbffca77a1b'}, 'attachment_id': '57465f8b-29e5-49af-9be8-c1b2aa2185b0', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'resources' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'numa_topology' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:53 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:14:53 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'vcpu_model' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xslSweYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:14:53 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:14:53 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:14:53 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[af20bd87-093b-4ea7-91b5-4acdb6ee0b13]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xslSweYi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 18:14:53 user nova-compute[72000]: node.name = iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b
Aug 16 18:14:53 user nova-compute[72000]: node.tpgt = -1
Aug 16 18:14:53 user nova-compute[72000]: node.startup = automatic
Aug 16 18:14:53 user nova-compute[72000]: node.leading_login = No
Aug 16 18:14:53 user nova-compute[72000]: iface.iscsi_ifacename = default
Aug 16 18:14:53 user nova-compute[72000]: iface.net_ifacename = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.ipaddress = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.prefix_len = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.hwaddress = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.transport_name = tcp
Aug 16 18:14:53 user nova-compute[72000]: iface.initiatorname = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.state = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.vlan_id = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.vlan_priority = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.vlan_state = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.iface_num = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.mtu = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.port = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.bootproto = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.subnet_mask = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.gateway = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.dhcp_alt_client_id = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.dhcp_dns = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.dhcp_learn_iqn = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.dhcp_vendor_id_state = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.dhcp_vendor_id = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.dhcp_slp_da = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.fragmentation = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.gratuitous_arp = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.incoming_forwarding = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.tos_state = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.tos = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.ttl = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.delayed_ack = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.tcp_nagle = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.tcp_wsf_state = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.tcp_wsf = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.tcp_timer_scale = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.tcp_timestamp = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.redirect = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.def_task_mgmt_timeout = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.header_digest = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.data_digest = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.immediate_data = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.initial_r2t = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.data_seq_inorder = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.data_pdu_inorder = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.erl = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.max_receive_data_len = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.first_burst_len = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.max_outstanding_r2t = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.max_burst_len = 0
Aug 16 18:14:53 user nova-compute[72000]: iface.chap_auth = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.bidi_chap = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.strict_login_compliance = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.discovery_auth = <empty>
Aug 16 18:14:53 user nova-compute[72000]: iface.discovery_logout = <empty>
Aug 16 18:14:53 user nova-compute[72000]: node.discovery_address = <empty>
Aug 16 18:14:53 user nova-compute[72000]: node.discovery_port = 0
Aug 16 18:14:53 user nova-compute[72000]: node.discovery_type = static
Aug 16 18:14:53 user nova-compute[72000]: node.session.initial_cmdsn = 0
Aug 16 18:14:53 user nova-compute[72000]: node.session.initial_login_retry_max = 8
Aug 16 18:14:53 user nova-compute[72000]: node.session.xmit_thread_priority = -20
Aug 16 18:14:53 user nova-compute[72000]: node.session.cmds_max = 128
Aug 16 18:14:53 user nova-compute[72000]: node.session.queue_depth = 32
Aug 16 18:14:53 user nova-compute[72000]: node.session.nr_sessions = 1
Aug 16 18:14:53 user nova-compute[72000]: node.session.auth.authmethod = CHAP
Aug 16 18:14:53 user nova-compute[72000]: node.session.auth.username = xslSweYi
Aug 16 18:14:53 user nova-compute[72000]: node.session.auth.password = ***
Aug 16 18:14:53 user nova-compute[72000]: node.session.auth.username_in = <empty>
Aug 16 18:14:53 user nova-compute[72000]: node.session.auth.password_in = <empty>
Aug 16 18:14:53 user nova-compute[72000]: node.session.auth.chap_algs = MD5
Aug 16 18:14:53 user nova-compute[72000]: node.session.timeo.replacement_timeout = 120
Aug 16 18:14:53 user nova-compute[72000]: node.session.err_timeo.abort_timeout = 15
Aug 16 18:14:53 user nova-compute[72000]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 18:14:53 user nova-compute[72000]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 18:14:53 user nova-compute[72000]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 18:14:53 user nova-compute[72000]: node.session.iscsi.FastAbort = Yes
Aug 16 18:14:53 user nova-compute[72000]: node.session.iscsi.InitialR2T = No
Aug 16 18:14:53 user nova-compute[72000]: node.session.iscsi.ImmediateData = Yes
Aug 16 18:14:53 user nova-compute[72000]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 18:14:53 user nova-compute[72000]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 18:14:53 user nova-compute[72000]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 18:14:53 user nova-compute[72000]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 18:14:53 user nova-compute[72000]: node.session.iscsi.MaxConnections = 1
Aug 16 18:14:53 user nova-compute[72000]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 18:14:53 user nova-compute[72000]: node.session.iscsi.ERL = 0
Aug 16 18:14:53 user nova-compute[72000]: node.session.scan = manual
Aug 16 18:14:53 user nova-compute[72000]: node.session.reopen_max = 0
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].address = 172.16.0.220
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].port = 3260
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].startup = manual
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].tcp.window_size = 524288
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].tcp.type_of_service = 0
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].timeo.logout_timeout = 15
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].timeo.login_timeout = 15
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].timeo.auth_timeout = 45
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].iscsi.DataDigest = None
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].iscsi.IFMarker = No
Aug 16 18:14:53 user nova-compute[72000]: node.conn[0].iscsi.OFMarker = No
Aug 16 18:14:53 user nova-compute[72000]: # END RECORD
Aug 16 18:14:53 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8d92ab-1756-4ce6-97c9-2a65bab1c9d3]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbcb9c6-50b9-4bd8-82b6-1d9097e8e6ce]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xslSweYi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xslSweYi" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d7c708-eab6-4f24-adc8-894b9599be9e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xslSweYi'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d780c0-e932-4031-8982-b9f16954331e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d189ad1-64fc-4702-a429-905bd469324b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)
Aug 16 18:14:53 user nova-compute[72000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:14:53 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)
Aug 16 18:14:53 user nova-compute[72000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:14:53 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] HCTL ('34', '0', '0', 0) found on session 31 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[721276b4-cc14-40d7-afea-45ff3f2bface]: (4, ('0 0 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Searching for a device in session 31 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xslSweYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.171s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '23165356431636465', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165356431636465', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2089464051',display_name='tempest-ServerStableDeviceRescueTest-server-2089464051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2089464051',id=23,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmWHm+7UdTQBS4QPyRtaW5DeIq9vhtWvX9ADUJEe3SmS2eKqAGYy5hZmyostFsGOQwmHmbgjvWY/LQB29YraeQXctLkJ0iVxnUHBvmf5NJW5jt7hxy6Ex17BeVwofI2yQ==',key_name='tempest-keypair-414040881',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9e27c5995794fe5bf7567c740f2570d',ramdisk_id='',reservation_id='r-otkbq97w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1493393985',owner_user_name='tempest-ServerStableDeviceRescueTest-1493393985-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d52e6531f15469cb663a6dda51b53fc',uuid=59b456c9-e5af-4e47-a2f1-ba4f35c8308a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "vif_mac": "fa:16:3e:02:5e:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Converting VIF {"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "vif_mac": "fa:16:3e:02:5e:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:5e:ea,bridge_name='br-int',has_traffic_filtering=True,id=52283d99-7220-49dd-92cd-8489ee426bc1,network=Network(16b11bd6-d226-449d-8035-04f4f3b3420a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52283d99-72') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'pci_devices' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:14:53 user nova-compute[72000]:   <uuid>59b456c9-e5af-4e47-a2f1-ba4f35c8308a</uuid>
Aug 16 18:14:53 user nova-compute[72000]:   <name>instance-00000017</name>
Aug 16 18:14:53 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:14:53 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:14:53 user nova-compute[72000]:   <metadata>
Aug 16 18:14:53 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:14:53 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:14:53 user nova-compute[72000]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2089464051</nova:name>
Aug 16 18:14:53 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:14:53</nova:creationTime>
Aug 16 18:14:53 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:14:53 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:14:53 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:14:53 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:14:53 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:14:53 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:14:53 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:14:53 user nova-compute[72000]:       <nova:owner>
Aug 16 18:14:53 user nova-compute[72000]:         <nova:user uuid="8d52e6531f15469cb663a6dda51b53fc">tempest-ServerStableDeviceRescueTest-1493393985-project-member</nova:user>
Aug 16 18:14:53 user nova-compute[72000]:         <nova:project uuid="a9e27c5995794fe5bf7567c740f2570d">tempest-ServerStableDeviceRescueTest-1493393985</nova:project>
Aug 16 18:14:53 user nova-compute[72000]:       </nova:owner>
Aug 16 18:14:53 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:14:53 user nova-compute[72000]:       <nova:ports>
Aug 16 18:14:53 user nova-compute[72000]:         <nova:port uuid="52283d99-7220-49dd-92cd-8489ee426bc1">
Aug 16 18:14:53 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 18:14:53 user nova-compute[72000]:         </nova:port>
Aug 16 18:14:53 user nova-compute[72000]:       </nova:ports>
Aug 16 18:14:53 user nova-compute[72000]:     </nova:instance>
Aug 16 18:14:53 user nova-compute[72000]:   </metadata>
Aug 16 18:14:53 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:14:53 user nova-compute[72000]:     <system>
Aug 16 18:14:53 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:14:53 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:14:53 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:14:53 user nova-compute[72000]:       <entry name="serial">59b456c9-e5af-4e47-a2f1-ba4f35c8308a</entry>
Aug 16 18:14:53 user nova-compute[72000]:       <entry name="uuid">59b456c9-e5af-4e47-a2f1-ba4f35c8308a</entry>
Aug 16 18:14:53 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:14:53 user nova-compute[72000]:     </system>
Aug 16 18:14:53 user nova-compute[72000]:   </sysinfo>
Aug 16 18:14:53 user nova-compute[72000]:   <os>
Aug 16 18:14:53 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:14:53 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:14:53 user nova-compute[72000]:   </os>
Aug 16 18:14:53 user nova-compute[72000]:   <features>
Aug 16 18:14:53 user nova-compute[72000]:     <acpi/>
Aug 16 18:14:53 user nova-compute[72000]:     <apic/>
Aug 16 18:14:53 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:14:53 user nova-compute[72000]:   </features>
Aug 16 18:14:53 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:14:53 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:14:53 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:14:53 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:14:53 user nova-compute[72000]:   </clock>
Aug 16 18:14:53 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:14:53 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:14:53 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:14:53 user nova-compute[72000]:   </cpu>
Aug 16 18:14:53 user nova-compute[72000]:   <devices>
Aug 16 18:14:53 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:14:53 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:14:53 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk"/>
Aug 16 18:14:53 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:14:53 user nova-compute[72000]:     </disk>
Aug 16 18:14:53 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:14:53 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:14:53 user nova-compute[72000]:       <source dev="/dev/sdc"/>
Aug 16 18:14:53 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:14:53 user nova-compute[72000]:       <serial>d404e6a3-3dc4-41ac-b92d-4cbffca77a1b</serial>
Aug 16 18:14:53 user nova-compute[72000]:     </disk>
Aug 16 18:14:53 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:14:53 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:14:53 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue"/>
Aug 16 18:14:53 user nova-compute[72000]:       <target dev="vdc" bus="virtio"/>
Aug 16 18:14:53 user nova-compute[72000]:       <boot order="1"/>
Aug 16 18:14:53 user nova-compute[72000]:     </disk>
Aug 16 18:14:53 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:14:53 user nova-compute[72000]:       <mac address="fa:16:3e:02:5e:ea"/>
Aug 16 18:14:53 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:14:53 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:14:53 user nova-compute[72000]:       <target dev="tap52283d99-72"/>
Aug 16 18:14:53 user nova-compute[72000]:     </interface>
Aug 16 18:14:53 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:14:53 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/console.log" append="off"/>
Aug 16 18:14:53 user nova-compute[72000]:     </serial>
Aug 16 18:14:53 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:14:53 user nova-compute[72000]:     <video>
Aug 16 18:14:53 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:14:53 user nova-compute[72000]:     </video>
Aug 16 18:14:53 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:14:53 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:14:53 user nova-compute[72000]:     </rng>
Aug 16 18:14:53 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:14:53 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:14:53 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:14:53 user nova-compute[72000]:     </memballoon>
Aug 16 18:14:53 user nova-compute[72000]:   </devices>
Aug 16 18:14:53 user nova-compute[72000]: </domain>
Aug 16 18:14:53 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:14:53 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Instance destroyed successfully.
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] No VIF found with MAC fa:16:3e:02:5e:ea, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:14:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-6134259c-ce82-43ef-870c-b2d89b0fa506 req-7a90f6b3-d873-4361-9c30-2ca5c2e3b76e service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6134259c-ce82-43ef-870c-b2d89b0fa506 req-7a90f6b3-d873-4361-9c30-2ca5c2e3b76e service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6134259c-ce82-43ef-870c-b2d89b0fa506 req-7a90f6b3-d873-4361-9c30-2ca5c2e3b76e service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6134259c-ce82-43ef-870c-b2d89b0fa506 req-7a90f6b3-d873-4361-9c30-2ca5c2e3b76e service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-6134259c-ce82-43ef-870c-b2d89b0fa506 req-7a90f6b3-d873-4361-9c30-2ca5c2e3b76e service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:14:55 user nova-compute[72000]: WARNING nova.compute.manager [req-6134259c-ce82-43ef-870c-b2d89b0fa506 req-7a90f6b3-d873-4361-9c30-2ca5c2e3b76e service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state active and task_state rescuing.
Aug 16 18:14:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:14:57 user nova-compute[72000]: DEBUG nova.compute.manager [req-504bf7d1-d0a9-4f1c-a0ee-c240cd2abf9a req-b69d6b34-ab74-405f-a5a7-527b282d1d2b service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:14:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-504bf7d1-d0a9-4f1c-a0ee-c240cd2abf9a req-b69d6b34-ab74-405f-a5a7-527b282d1d2b service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:14:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-504bf7d1-d0a9-4f1c-a0ee-c240cd2abf9a req-b69d6b34-ab74-405f-a5a7-527b282d1d2b service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:14:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-504bf7d1-d0a9-4f1c-a0ee-c240cd2abf9a req-b69d6b34-ab74-405f-a5a7-527b282d1d2b service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:14:57 user nova-compute[72000]: DEBUG nova.compute.manager [req-504bf7d1-d0a9-4f1c-a0ee-c240cd2abf9a req-b69d6b34-ab74-405f-a5a7-527b282d1d2b service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:14:57 user nova-compute[72000]: WARNING nova.compute.manager [req-504bf7d1-d0a9-4f1c-a0ee-c240cd2abf9a req-b69d6b34-ab74-405f-a5a7-527b282d1d2b service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state active and task_state rescuing.
Aug 16 18:14:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for 59b456c9-e5af-4e47-a2f1-ba4f35c8308a due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:14:57 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209697.7329068, 59b456c9-e5af-4e47-a2f1-ba4f35c8308a => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:14:57 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] VM Resumed (Lifecycle Event)
Aug 16 18:14:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9287e42e-3c80-456e-98f0-8154a50c46e6 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:14:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:14:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:14:57 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 18:14:57 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209697.7340379, 59b456c9-e5af-4e47-a2f1-ba4f35c8308a => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:14:57 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] VM Started (Lifecycle Event)
Aug 16 18:14:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:14:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:14:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:15:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:18 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:15:18 user nova-compute[72000]: INFO nova.compute.claims [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Claim successful on node user
Aug 16 18:15:19 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:15:19 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:15:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG nova.policy [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfe1063b05894bfeb8f08bc29602b2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b557a84c43a47db90c0eb7054a77446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:15:19 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Creating image(s)
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "/opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "/opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.198s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk 1073741824" returned: 0 in 0.056s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.234s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Successfully created port: 6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Cannot resize image /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'migration_context' on Instance uuid ca0dfc09-f74e-4237-8759-a46b1842ee85 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Ensure instance console log exists: /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Successfully updated port: 6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "refresh_cache-ca0dfc09-f74e-4237-8759-a46b1842ee85" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquired lock "refresh_cache-ca0dfc09-f74e-4237-8759-a46b1842ee85" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-9a4006f8-ecd7-437c-91db-bf3c6e91ea3f req-8082f3d3-da3d-4748-8435-7c7b179167ed service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received event network-changed-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-9a4006f8-ecd7-437c-91db-bf3c6e91ea3f req-8082f3d3-da3d-4748-8435-7c7b179167ed service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Refreshing instance network info cache due to event network-changed-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9a4006f8-ecd7-437c-91db-bf3c6e91ea3f req-8082f3d3-da3d-4748-8435-7c7b179167ed service nova] Acquiring lock "refresh_cache-ca0dfc09-f74e-4237-8759-a46b1842ee85" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:15:20 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Updating instance_info_cache with network_info: [{"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Releasing lock "refresh_cache-ca0dfc09-f74e-4237-8759-a46b1842ee85" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Instance network_info: |[{"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9a4006f8-ecd7-437c-91db-bf3c6e91ea3f req-8082f3d3-da3d-4748-8435-7c7b179167ed service nova] Acquired lock "refresh_cache-ca0dfc09-f74e-4237-8759-a46b1842ee85" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.network.neutron [req-9a4006f8-ecd7-437c-91db-bf3c6e91ea3f req-8082f3d3-da3d-4748-8435-7c7b179167ed service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Refreshing network info cache for port 6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Start _get_guest_xml network_info=[{"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:15:21 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:15:21 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1532322913',display_name='tempest-AttachVolumeNegativeTest-server-1532322913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1532322913',id=30,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmL3i4ASh8OCnviZVLXg0C96eS/a4ERtuPdcErYosbwBqbJ9AbQFci4edhfAlGtvHyN7pyLLnvxh+rdBOaggwgiVaji7zs0EphOOi0EnHU+9B4PaOgebGuLJm89gdRpGQ==',key_name='tempest-keypair-1792687114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-gazm4wsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=ca0dfc09-f74e-4237-8759-a46b1842ee85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:f4:2c,bridge_name='br-int',has_traffic_filtering=True,id=6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ef2ad33-df') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'pci_devices' on Instance uuid ca0dfc09-f74e-4237-8759-a46b1842ee85 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:15:21 user nova-compute[72000]:   <uuid>ca0dfc09-f74e-4237-8759-a46b1842ee85</uuid>
Aug 16 18:15:21 user nova-compute[72000]:   <name>instance-0000001e</name>
Aug 16 18:15:21 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:15:21 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:15:21 user nova-compute[72000]:   <metadata>
Aug 16 18:15:21 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:15:21 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:15:21 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1532322913</nova:name>
Aug 16 18:15:21 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:15:21</nova:creationTime>
Aug 16 18:15:21 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:15:21 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:15:21 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:15:21 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:15:21 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:15:21 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:15:21 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:15:21 user nova-compute[72000]:       <nova:owner>
Aug 16 18:15:21 user nova-compute[72000]:         <nova:user uuid="cfe1063b05894bfeb8f08bc29602b2fa">tempest-AttachVolumeNegativeTest-678349136-project-member</nova:user>
Aug 16 18:15:21 user nova-compute[72000]:         <nova:project uuid="9b557a84c43a47db90c0eb7054a77446">tempest-AttachVolumeNegativeTest-678349136</nova:project>
Aug 16 18:15:21 user nova-compute[72000]:       </nova:owner>
Aug 16 18:15:21 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:15:21 user nova-compute[72000]:       <nova:ports>
Aug 16 18:15:21 user nova-compute[72000]:         <nova:port uuid="6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c">
Aug 16 18:15:21 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 18:15:21 user nova-compute[72000]:         </nova:port>
Aug 16 18:15:21 user nova-compute[72000]:       </nova:ports>
Aug 16 18:15:21 user nova-compute[72000]:     </nova:instance>
Aug 16 18:15:21 user nova-compute[72000]:   </metadata>
Aug 16 18:15:21 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:15:21 user nova-compute[72000]:     <system>
Aug 16 18:15:21 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:15:21 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:15:21 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:15:21 user nova-compute[72000]:       <entry name="serial">ca0dfc09-f74e-4237-8759-a46b1842ee85</entry>
Aug 16 18:15:21 user nova-compute[72000]:       <entry name="uuid">ca0dfc09-f74e-4237-8759-a46b1842ee85</entry>
Aug 16 18:15:21 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:15:21 user nova-compute[72000]:     </system>
Aug 16 18:15:21 user nova-compute[72000]:   </sysinfo>
Aug 16 18:15:21 user nova-compute[72000]:   <os>
Aug 16 18:15:21 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:15:21 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:15:21 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:15:21 user nova-compute[72000]:   </os>
Aug 16 18:15:21 user nova-compute[72000]:   <features>
Aug 16 18:15:21 user nova-compute[72000]:     <acpi/>
Aug 16 18:15:21 user nova-compute[72000]:     <apic/>
Aug 16 18:15:21 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:15:21 user nova-compute[72000]:   </features>
Aug 16 18:15:21 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:15:21 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:15:21 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:15:21 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:15:21 user nova-compute[72000]:   </clock>
Aug 16 18:15:21 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:15:21 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:15:21 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:15:21 user nova-compute[72000]:   </cpu>
Aug 16 18:15:21 user nova-compute[72000]:   <devices>
Aug 16 18:15:21 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:15:21 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:15:21 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk"/>
Aug 16 18:15:21 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:15:21 user nova-compute[72000]:     </disk>
Aug 16 18:15:21 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:15:21 user nova-compute[72000]:       <mac address="fa:16:3e:8d:f4:2c"/>
Aug 16 18:15:21 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:15:21 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:15:21 user nova-compute[72000]:       <target dev="tap6ef2ad33-df"/>
Aug 16 18:15:21 user nova-compute[72000]:     </interface>
Aug 16 18:15:21 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:15:21 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/console.log" append="off"/>
Aug 16 18:15:21 user nova-compute[72000]:     </serial>
Aug 16 18:15:21 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:15:21 user nova-compute[72000]:     <video>
Aug 16 18:15:21 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:15:21 user nova-compute[72000]:     </video>
Aug 16 18:15:21 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:15:21 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:15:21 user nova-compute[72000]:     </rng>
Aug 16 18:15:21 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:15:21 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:15:21 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:15:21 user nova-compute[72000]:     </memballoon>
Aug 16 18:15:21 user nova-compute[72000]:   </devices>
Aug 16 18:15:21 user nova-compute[72000]: </domain>
Aug 16 18:15:21 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1532322913',display_name='tempest-AttachVolumeNegativeTest-server-1532322913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1532322913',id=30,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmL3i4ASh8OCnviZVLXg0C96eS/a4ERtuPdcErYosbwBqbJ9AbQFci4edhfAlGtvHyN7pyLLnvxh+rdBOaggwgiVaji7zs0EphOOi0EnHU+9B4PaOgebGuLJm89gdRpGQ==',key_name='tempest-keypair-1792687114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-gazm4wsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=ca0dfc09-f74e-4237-8759-a46b1842ee85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:f4:2c,bridge_name='br-int',has_traffic_filtering=True,id=6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ef2ad33-df') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG os_vif [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:f4:2c,bridge_name='br-int',has_traffic_filtering=True,id=6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ef2ad33-df') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ef2ad33-df, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ef2ad33-df, col_values=(('external_ids', {'iface-id': '6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:f4:2c', 'vm-uuid': 'ca0dfc09-f74e-4237-8759-a46b1842ee85'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:21 user nova-compute[72000]: INFO os_vif [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:f4:2c,bridge_name='br-int',has_traffic_filtering=True,id=6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ef2ad33-df')
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No VIF found with MAC fa:16:3e:8d:f4:2c, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.network.neutron [req-9a4006f8-ecd7-437c-91db-bf3c6e91ea3f req-8082f3d3-da3d-4748-8435-7c7b179167ed service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Updated VIF entry in instance network info cache for port 6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG nova.network.neutron [req-9a4006f8-ecd7-437c-91db-bf3c6e91ea3f req-8082f3d3-da3d-4748-8435-7c7b179167ed service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Updating instance_info_cache with network_info: [{"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:15:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9a4006f8-ecd7-437c-91db-bf3c6e91ea3f req-8082f3d3-da3d-4748-8435-7c7b179167ed service nova] Releasing lock "refresh_cache-ca0dfc09-f74e-4237-8759-a46b1842ee85" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:15:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-372d1ce7-78d1-4142-be08-79c2ddf125f8 req-6f837723-6661-4a88-a5c6-ea594a27ad1b service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received event network-vif-plugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-372d1ce7-78d1-4142-be08-79c2ddf125f8 req-6f837723-6661-4a88-a5c6-ea594a27ad1b service nova] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-372d1ce7-78d1-4142-be08-79c2ddf125f8 req-6f837723-6661-4a88-a5c6-ea594a27ad1b service nova] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-372d1ce7-78d1-4142-be08-79c2ddf125f8 req-6f837723-6661-4a88-a5c6-ea594a27ad1b service nova] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-372d1ce7-78d1-4142-be08-79c2ddf125f8 req-6f837723-6661-4a88-a5c6-ea594a27ad1b service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] No waiting events found dispatching network-vif-plugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:15:22 user nova-compute[72000]: WARNING nova.compute.manager [req-372d1ce7-78d1-4142-be08-79c2ddf125f8 req-6f837723-6661-4a88-a5c6-ea594a27ad1b service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received unexpected event network-vif-plugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c for instance with vm_state building and task_state spawning.
Aug 16 18:15:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updating instance_info_cache with network_info: [{"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:15:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209724.9035497, ca0dfc09-f74e-4237-8759-a46b1842ee85 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:15:24 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] VM Resumed (Lifecycle Event)
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:15:24 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Instance spawned successfully.
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:15:24 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209724.9052196, ca0dfc09-f74e-4237-8759-a46b1842ee85 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:15:24 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] VM Started (Lifecycle Event)
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-0493ddbb-f9f5-446f-a37d-721597ec73de req-dc205c5c-dbdc-4d21-8720-48578b23371d service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received event network-vif-plugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0493ddbb-f9f5-446f-a37d-721597ec73de req-dc205c5c-dbdc-4d21-8720-48578b23371d service nova] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0493ddbb-f9f5-446f-a37d-721597ec73de req-dc205c5c-dbdc-4d21-8720-48578b23371d service nova] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0493ddbb-f9f5-446f-a37d-721597ec73de req-dc205c5c-dbdc-4d21-8720-48578b23371d service nova] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-0493ddbb-f9f5-446f-a37d-721597ec73de req-dc205c5c-dbdc-4d21-8720-48578b23371d service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] No waiting events found dispatching network-vif-plugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:15:24 user nova-compute[72000]: WARNING nova.compute.manager [req-0493ddbb-f9f5-446f-a37d-721597ec73de req-dc205c5c-dbdc-4d21-8720-48578b23371d service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received unexpected event network-vif-plugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c for instance with vm_state building and task_state spawning.
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:15:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:15:25 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:15:25 user nova-compute[72000]: INFO nova.compute.manager [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 16 18:15:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:15:25 user nova-compute[72000]: INFO nova.compute.manager [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Took 6.38 seconds to build instance.
Aug 16 18:15:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ccf034a7-f35e-4f15-a55c-b3a09a3db507 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.489s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:15:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:25 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:15:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-76a4d330-5317-4c85-8cbb-282bea9b5e47 req-bee30e96-3cd0-4328-8f27-7a6162d07c42 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-changed-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-76a4d330-5317-4c85-8cbb-282bea9b5e47 req-bee30e96-3cd0-4328-8f27-7a6162d07c42 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Refreshing instance network info cache due to event network-changed-675351e2-f9ae-41cd-a810-fb1d45a7186a. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-76a4d330-5317-4c85-8cbb-282bea9b5e47 req-bee30e96-3cd0-4328-8f27-7a6162d07c42 service nova] Acquiring lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-76a4d330-5317-4c85-8cbb-282bea9b5e47 req-bee30e96-3cd0-4328-8f27-7a6162d07c42 service nova] Acquired lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG nova.network.neutron [req-76a4d330-5317-4c85-8cbb-282bea9b5e47 req-bee30e96-3cd0-4328-8f27-7a6162d07c42 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Refreshing network info cache for port 675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG nova.objects.instance [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'flavor' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.016s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:28 user nova-compute[72000]: INFO nova.compute.manager [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Attaching volume e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 to /dev/vdb
Aug 16 18:15:28 user nova-compute[72000]: DEBUG os_brick.utils [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:15:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c55c9e6-4d1a-4a9e-a902-f61401de35e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98e851e-8cd7-4d66-872e-cee5e3a347c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-76a4d330-5317-4c85-8cbb-282bea9b5e47 req-bee30e96-3cd0-4328-8f27-7a6162d07c42 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updated VIF entry in instance network info cache for port 675351e2-f9ae-41cd-a810-fb1d45a7186a. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-76a4d330-5317-4c85-8cbb-282bea9b5e47 req-bee30e96-3cd0-4328-8f27-7a6162d07c42 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updating instance_info_cache with network_info: [{"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3715f45-efea-4f94-bc63-f6f9f3c9ad4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-76a4d330-5317-4c85-8cbb-282bea9b5e47 req-bee30e96-3cd0-4328-8f27-7a6162d07c42 service nova] Releasing lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b575440-604c-49ab-be6f-cfea5599f4ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:15:29 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cfe1c0-2364-4329-9e28-7f783f9a4f62]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG os_brick.utils [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updating existing volume attachment record: a36a14e3-ef42-427e-804e-f28436934384 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-77121329-a22f-4b7a-8395-f3deef6b7812 req-373afc97-be3d-4cdd-b0cc-09da4fffe033 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received event network-changed-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-77121329-a22f-4b7a-8395-f3deef6b7812 req-373afc97-be3d-4cdd-b0cc-09da4fffe033 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Refreshing instance network info cache due to event network-changed-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-77121329-a22f-4b7a-8395-f3deef6b7812 req-373afc97-be3d-4cdd-b0cc-09da4fffe033 service nova] Acquiring lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-77121329-a22f-4b7a-8395-f3deef6b7812 req-373afc97-be3d-4cdd-b0cc-09da4fffe033 service nova] Acquired lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.network.neutron [req-77121329-a22f-4b7a-8395-f3deef6b7812 req-373afc97-be3d-4cdd-b0cc-09da4fffe033 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Refreshing network info cache for port a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:15:31 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:15:31 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7353MB free_disk=23.609073638916016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 89561a1c-6fae-4ded-865b-d338e86e40d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 618b087f-3794-4508-bc46-a30f888525ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 04c75ec7-92c4-4130-8846-e867dd5384c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance ca0dfc09-f74e-4237-8759-a46b1842ee85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'flavor' on Instance uuid 618b087f-3794-4508-bc46-a30f888525ec {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:31 user nova-compute[72000]: INFO nova.compute.manager [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Attaching volume 5274fa18-7d3f-4ffe-9f7b-af97417d0e1b to /dev/vdb
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.network.neutron [req-77121329-a22f-4b7a-8395-f3deef6b7812 req-373afc97-be3d-4cdd-b0cc-09da4fffe033 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Updated VIF entry in instance network info cache for port a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.network.neutron [req-77121329-a22f-4b7a-8395-f3deef6b7812 req-373afc97-be3d-4cdd-b0cc-09da4fffe033 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Updating instance_info_cache with network_info: [{"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-77121329-a22f-4b7a-8395-f3deef6b7812 req-373afc97-be3d-4cdd-b0cc-09da4fffe033 service nova] Releasing lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG os_brick.utils [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd8ca9-06e7-4e7a-9fc5-ac9593a9e955]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f78338d-fbc8-46fe-934d-d4986005dffb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[207fe06a-3b4a-4174-8b0f-8ba489fa42cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7c1dcf-55b5-484b-b5d7-6320d9a0328a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:15:31 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:15:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac984c-68ae-42f9-85a9-a18109479ce1]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG os_brick.utils [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:15:31 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Updating existing volume attachment record: c6a302f3-60be-4067-8c45-38bd75cfdeaf {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:15:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "89561a1c-6fae-4ded-865b-d338e86e40d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:39 user nova-compute[72000]: INFO nova.compute.manager [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Detaching volume 2d800661-1e92-40da-955e-38d055ff1afc
Aug 16 18:15:39 user nova-compute[72000]: INFO nova.virt.block_device [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Attempting to driver detach volume 2d800661-1e92-40da-955e-38d055ff1afc from mountpoint /dev/vdb
Aug 16 18:15:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Attempting to detach device vdb from instance 89561a1c-6fae-4ded-865b-d338e86e40d8 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:15:39 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:15:39 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:15:39 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:15:39 user nova-compute[72000]:   <serial>2d800661-1e92-40da-955e-38d055ff1afc</serial>
Aug 16 18:15:39 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:15:39 user nova-compute[72000]: </disk>
Aug 16 18:15:39 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:15:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Successfully detached device vdb from instance 89561a1c-6fae-4ded-865b-d338e86e40d8 from the persistent domain config.
Aug 16 18:15:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89561a1c-6fae-4ded-865b-d338e86e40d8 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:15:39 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:15:39 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:15:39 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:15:39 user nova-compute[72000]:   <serial>2d800661-1e92-40da-955e-38d055ff1afc</serial>
Aug 16 18:15:39 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:15:39 user nova-compute[72000]: </disk>
Aug 16 18:15:39 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "89561a1c-6fae-4ded-865b-d338e86e40d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209739.6058495, 89561a1c-6fae-4ded-865b-d338e86e40d8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89561a1c-6fae-4ded-865b-d338e86e40d8 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:15:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Successfully detached device vdb from instance 89561a1c-6fae-4ded-865b-d338e86e40d8 from the live domain config.
Aug 16 18:15:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIqityk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:15:39 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1191a6-7d04-4bcc-ae33-90a192ef2d73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d49c58-6d4b-4a45-8b1e-aa040c70d824]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)
Aug 16 18:15:39 user nova-compute[72000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc (non-flash)
Aug 16 18:15:39 user nova-compute[72000]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcfe8726b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f4e6a6-bf99-4b27-b0cc-107fdc14dd77]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[48306b05-067c-4a84-afbc-f5d5b4a34ad2]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[261444f5-5782-4c4d-9126-437a7ac68177]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8bc6e5-9c40-4686-9ddb-3b9c9cc6b9a6]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afe2e6c-a25f-44d2-af5e-9b83af870605]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c4a8c7-647b-4950-ad9e-2b2ffa16cdb0]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc, portal: 172.16.0.220,3260]
Aug 16 18:15:39 user nova-compute[72000]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc, portal: 172.16.0.220,3260] successful.
Aug 16 18:15:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7cc96c-0a05-41dc-97b6-c06140319df2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] <== disconnect_volume: return (312ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmrRbDgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:15:39 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:15:39 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:15:39 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aeb428-c145-4773-bef9-7d4fe0a3ad41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:15:39 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6744e3-f91e-4521-ade9-04de287bcbb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5] added
Aug 16 18:15:40 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3599dbc8-747b-4773-a661-f2fad469f0c0]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5116ec9f-1e7f-405c-838e-1cf8f2ab5ef2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmrRbDgS {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmrRbDgS" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edaf412-2f25-4de9-bb59-ed35a9a29d77]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TmrRbDgS'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e40dc5e-9813-4e5c-a1fb-31e94b650a83]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9f65e5-4e89-4892-b490-c1c3a339a31f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:40 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:40 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b894c0-1c71-4c54-a839-ad52b0d0c02f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5, portal: 172.16.0.220,3260]
Aug 16 18:15:40 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5, portal: 172.16.0.220,3260] successful.
Aug 16 18:15:40 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c043912-a1c7-4451-87e3-ad0543721858]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[183ff222-9611-480d-a55a-2984d48b2ba0]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:40 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:15:40 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:40 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:15:40 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c694997a-a1f3-4dfb-80ec-8b0359edefef]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmrRbDgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG nova.objects.instance [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'flavor' on Instance uuid 89561a1c-6fae-4ded-865b-d338e86e40d8 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1439f094-7644-4fae-b627-b053cb8812ea tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.634s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:40 user nova-compute[72000]: INFO nova.compute.manager [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Terminating instance
Aug 16 18:15:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-d82faadf-f4af-4052-a67a-9293a89a8ead req-41c9395e-92a4-42c8-a40b-92b6282567d7 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received event network-vif-unplugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d82faadf-f4af-4052-a67a-9293a89a8ead req-41c9395e-92a4-42c8-a40b-92b6282567d7 service nova] Acquiring lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d82faadf-f4af-4052-a67a-9293a89a8ead req-41c9395e-92a4-42c8-a40b-92b6282567d7 service nova] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d82faadf-f4af-4052-a67a-9293a89a8ead req-41c9395e-92a4-42c8-a40b-92b6282567d7 service nova] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-d82faadf-f4af-4052-a67a-9293a89a8ead req-41c9395e-92a4-42c8-a40b-92b6282567d7 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] No waiting events found dispatching network-vif-unplugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-d82faadf-f4af-4052-a67a-9293a89a8ead req-41c9395e-92a4-42c8-a40b-92b6282567d7 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received event network-vif-unplugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23062633661633865', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062633661633865', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.objects.instance [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'flavor' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:15:41 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:15:41 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:15:41 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:15:41 user nova-compute[72000]:   <serial>e28ae0c1-16ae-463d-a1b1-6974b7adc5d5</serial>
Aug 16 18:15:41 user nova-compute[72000]: </disk>
Aug 16 18:15:41 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:41 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Instance destroyed successfully.
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.objects.instance [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'resources' on Instance uuid 89561a1c-6fae-4ded-865b-d338e86e40d8 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:12:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1535869376',display_name='tempest-VolumesSnapshotTestJSON-instance-1535869376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1535869376',id=25,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFq7xvRIOl1VZ1ploiuuyZVolWn4EdyGs5cdJRMiWYFo6W/z4E9n1L70i6WxbKN/xBsWC//UuPVPYKq/YIxOa2k1cxEWSsjb3RsmB4HrdEoJ+zUsdTWxU5TnSQsl+wzw8w==',key_name='tempest-keypair-1215735593',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:12:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='502f251cf3c6455cb4f5beb33be18cce',ramdisk_id='',reservation_id='r-v84vud0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2014651615',owner_user_name='tempest-VolumesSnapshotTestJSON-2014651615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e80d9a8665e34853897db6bd52e55b87',uuid=89561a1c-6fae-4ded-865b-d338e86e40d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converting VIF {"id": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "address": "fa:16:3e:99:83:dc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68d2b5b6-dc", "ovs_interfaceid": "68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:83:dc,bridge_name='br-int',has_traffic_filtering=True,id=68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d2b5b6-dc') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_vif [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:83:dc,bridge_name='br-int',has_traffic_filtering=True,id=68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d2b5b6-dc') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68d2b5b6-dc, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:41 user nova-compute[72000]: INFO os_vif [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:83:dc,bridge_name='br-int',has_traffic_filtering=True,id=68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68d2b5b6-dc')
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANIqityk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:15:41 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d800661-1e92-40da-955e-38d055ff1afc', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80378fbf-8c75-4aea-aa7a-5a98f9d5e399]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No VIF found with MAC fa:16:3e:c8:70:1c, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7c088e-c866-447a-95b3-4347a254cdfa]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:41 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:15:41 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:41 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:15:41 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01139b5b0>, {}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Disconnecting from: [] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.060s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] <== disconnect_volume: return (62ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:15:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:15:41 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Deleting instance files /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8_del
Aug 16 18:15:41 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Deletion of /opt/stack/data/nova/instances/89561a1c-6fae-4ded-865b-d338e86e40d8_del complete
Aug 16 18:15:42 user nova-compute[72000]: INFO nova.compute.manager [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 16 18:15:42 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:15:42 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:15:42 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:15:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69719301-1a07-4266-b22f-add52899b33f tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.150s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:43 user nova-compute[72000]: INFO nova.compute.manager [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Rescuing
Aug 16 18:15:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquired lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG nova.network.neutron [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-3875b41f-b5e3-4ce9-a07a-bd9f6f91b3d8 req-42802c32-f4d5-4034-9b92-92acf02a65cb service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received event network-vif-plugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3875b41f-b5e3-4ce9-a07a-bd9f6f91b3d8 req-42802c32-f4d5-4034-9b92-92acf02a65cb service nova] Acquiring lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3875b41f-b5e3-4ce9-a07a-bd9f6f91b3d8 req-42802c32-f4d5-4034-9b92-92acf02a65cb service nova] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3875b41f-b5e3-4ce9-a07a-bd9f6f91b3d8 req-42802c32-f4d5-4034-9b92-92acf02a65cb service nova] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-3875b41f-b5e3-4ce9-a07a-bd9f6f91b3d8 req-42802c32-f4d5-4034-9b92-92acf02a65cb service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] No waiting events found dispatching network-vif-plugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:15:43 user nova-compute[72000]: WARNING nova.compute.manager [req-3875b41f-b5e3-4ce9-a07a-bd9f6f91b3d8 req-42802c32-f4d5-4034-9b92-92acf02a65cb service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received unexpected event network-vif-plugged-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 for instance with vm_state active and task_state deleting.
Aug 16 18:15:43 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:15:43 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Took 1.27 seconds to deallocate network for instance.
Aug 16 18:15:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-125abb50-f719-4825-a589-81ecc3447408 req-5f0fcd04-4549-423f-b4fc-5583830fc316 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Received event network-vif-deleted-68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:43 user nova-compute[72000]: INFO nova.compute.manager [req-125abb50-f719-4825-a589-81ecc3447408 req-5f0fcd04-4549-423f-b4fc-5583830fc316 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Neutron deleted interface 68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0; detaching it from the instance and deleting it from the info cache
Aug 16 18:15:43 user nova-compute[72000]: DEBUG nova.network.neutron [req-125abb50-f719-4825-a589-81ecc3447408 req-5f0fcd04-4549-423f-b4fc-5583830fc316 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:15:43 user nova-compute[72000]: WARNING nova.volume.cinder [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Attachment b75a9fcf-a935-4d18-bbf7-995cd8127c6a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b75a9fcf-a935-4d18-bbf7-995cd8127c6a. (HTTP 404) (Request-ID: req-e6b9e2fc-2ba5-4d54-95ba-a6c771ad662d)
Aug 16 18:15:43 user nova-compute[72000]: INFO nova.compute.manager [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Took 0.02 seconds to detach 1 volumes for instance.
Aug 16 18:15:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-125abb50-f719-4825-a589-81ecc3447408 req-5f0fcd04-4549-423f-b4fc-5583830fc316 service nova] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Detach interface failed, port_id=68d2b5b6-dc3f-48cd-8f13-43287d5b7aa0, reason: Instance 89561a1c-6fae-4ded-865b-d338e86e40d8 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG nova.network.neutron [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updating instance_info_cache with network_info: [{"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Releasing lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:15:43 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Deleted allocations for instance 89561a1c-6fae-4ded-865b-d338e86e40d8
Aug 16 18:15:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-402fc4cc-d664-4c24-82a8-3e8b44d3e441 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "89561a1c-6fae-4ded-865b-d338e86e40d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:44 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Instance destroyed successfully.
Aug 16 18:15:44 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Attempting rescue
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Instance directory exists: not creating {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 18:15:44 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Creating image(s)
Aug 16 18:15:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.objects.instance [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'trusted_certs' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue" returned: 0 in 0.050s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.objects.instance [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'migration_context' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Start _get_guest_xml network_info=[{"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "vif_mac": "fa:16:3e:c8:70:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.objects.instance [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'resources' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.objects.instance [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'numa_topology' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:44 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:15:44 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.objects.instance [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'vcpu_model' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1881362050',display_name='tempest-ServerRescueNegativeTestJSON-server-1881362050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1881362050',id=26,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOax8cUTQytSdtGTyC9MeCOoaVGwmHO7ZUgzG4i+NFpXjqfhVR25SFddxqnnAXGZgfzQbOc5+YYks+mN9ZsSDQcEAlypm3l3jev6N/AWDWshdH5tGXlV+Y3ZzhzTJGdBA==',key_name='tempest-keypair-1907527833',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-g5r9ilfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d07d329987884ac98b87374ca2074b86',uuid=bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "vif_mac": "fa:16:3e:c8:70:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "vif_mac": "fa:16:3e:c8:70:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:70:1c,bridge_name='br-int',has_traffic_filtering=True,id=675351e2-f9ae-41cd-a810-fb1d45a7186a,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap675351e2-f9') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.objects.instance [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'pci_devices' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:15:44 user nova-compute[72000]:   <uuid>bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d</uuid>
Aug 16 18:15:44 user nova-compute[72000]:   <name>instance-0000001a</name>
Aug 16 18:15:44 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:15:44 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:15:44 user nova-compute[72000]:   <metadata>
Aug 16 18:15:44 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:15:44 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:15:44 user nova-compute[72000]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1881362050</nova:name>
Aug 16 18:15:44 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:15:44</nova:creationTime>
Aug 16 18:15:44 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:15:44 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:15:44 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:15:44 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:15:44 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:15:44 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:15:44 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:15:44 user nova-compute[72000]:       <nova:owner>
Aug 16 18:15:44 user nova-compute[72000]:         <nova:user uuid="d07d329987884ac98b87374ca2074b86">tempest-ServerRescueNegativeTestJSON-1605720785-project-member</nova:user>
Aug 16 18:15:44 user nova-compute[72000]:         <nova:project uuid="5442ba2319584631a81b2d1208b5f65f">tempest-ServerRescueNegativeTestJSON-1605720785</nova:project>
Aug 16 18:15:44 user nova-compute[72000]:       </nova:owner>
Aug 16 18:15:44 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:15:44 user nova-compute[72000]:       <nova:ports>
Aug 16 18:15:44 user nova-compute[72000]:         <nova:port uuid="675351e2-f9ae-41cd-a810-fb1d45a7186a">
Aug 16 18:15:44 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 18:15:44 user nova-compute[72000]:         </nova:port>
Aug 16 18:15:44 user nova-compute[72000]:       </nova:ports>
Aug 16 18:15:44 user nova-compute[72000]:     </nova:instance>
Aug 16 18:15:44 user nova-compute[72000]:   </metadata>
Aug 16 18:15:44 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:15:44 user nova-compute[72000]:     <system>
Aug 16 18:15:44 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:15:44 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:15:44 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:15:44 user nova-compute[72000]:       <entry name="serial">bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d</entry>
Aug 16 18:15:44 user nova-compute[72000]:       <entry name="uuid">bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d</entry>
Aug 16 18:15:44 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:15:44 user nova-compute[72000]:     </system>
Aug 16 18:15:44 user nova-compute[72000]:   </sysinfo>
Aug 16 18:15:44 user nova-compute[72000]:   <os>
Aug 16 18:15:44 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:15:44 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:15:44 user nova-compute[72000]:   </os>
Aug 16 18:15:44 user nova-compute[72000]:   <features>
Aug 16 18:15:44 user nova-compute[72000]:     <acpi/>
Aug 16 18:15:44 user nova-compute[72000]:     <apic/>
Aug 16 18:15:44 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:15:44 user nova-compute[72000]:   </features>
Aug 16 18:15:44 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:15:44 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:15:44 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:15:44 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:15:44 user nova-compute[72000]:   </clock>
Aug 16 18:15:44 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:15:44 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:15:44 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:15:44 user nova-compute[72000]:   </cpu>
Aug 16 18:15:44 user nova-compute[72000]:   <devices>
Aug 16 18:15:44 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:15:44 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:15:44 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue"/>
Aug 16 18:15:44 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:15:44 user nova-compute[72000]:     </disk>
Aug 16 18:15:44 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:15:44 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:15:44 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk"/>
Aug 16 18:15:44 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:15:44 user nova-compute[72000]:     </disk>
Aug 16 18:15:44 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:15:44 user nova-compute[72000]:       <mac address="fa:16:3e:c8:70:1c"/>
Aug 16 18:15:44 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:15:44 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:15:44 user nova-compute[72000]:       <target dev="tap675351e2-f9"/>
Aug 16 18:15:44 user nova-compute[72000]:     </interface>
Aug 16 18:15:44 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:15:44 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/console.log" append="off"/>
Aug 16 18:15:44 user nova-compute[72000]:     </serial>
Aug 16 18:15:44 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:15:44 user nova-compute[72000]:     <video>
Aug 16 18:15:44 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:15:44 user nova-compute[72000]:     </video>
Aug 16 18:15:44 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:15:44 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:15:44 user nova-compute[72000]:     </rng>
Aug 16 18:15:44 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:15:44 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:15:44 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:15:44 user nova-compute[72000]:     </memballoon>
Aug 16 18:15:44 user nova-compute[72000]:   </devices>
Aug 16 18:15:44 user nova-compute[72000]: </domain>
Aug 16 18:15:44 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:15:45 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Instance destroyed successfully.
Aug 16 18:15:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] No VIF found with MAC fa:16:3e:c8:70:1c, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:15:45 user nova-compute[72000]: WARNING nova.compute.manager [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state active and task_state rescuing.
Aug 16 18:15:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:15:45 user nova-compute[72000]: WARNING nova.compute.manager [req-fc4fd3ba-b3fc-4a1d-a6dd-18dcb2716785 req-2c83d3ee-d5ac-4a2a-9de9-7b906d0e0664 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state active and task_state rescuing.
Aug 16 18:15:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:15:47 user nova-compute[72000]: WARNING nova.compute.manager [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state active and task_state rescuing.
Aug 16 18:15:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:15:47 user nova-compute[72000]: WARNING nova.compute.manager [req-6562095a-754f-4126-8d62-bb1fc05d7b33 req-f5fa45ff-dde7-4ef7-9fe9-30167b6163e1 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state active and task_state rescuing.
Aug 16 18:15:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:15:48 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209748.4896026, bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:15:48 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] VM Resumed (Lifecycle Event)
Aug 16 18:15:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-462e676b-f6e2-4335-9ab4-3a4c28bc30b2 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:15:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:15:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:15:48 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 18:15:48 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209748.4945629, bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:15:48 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] VM Started (Lifecycle Event)
Aug 16 18:15:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:15:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:15:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZsMwdac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:15:49 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:15:49 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:15:49 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[450311e0-9e4e-4576-9a72-e9d1374585e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:15:49 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d61a980-941f-4689-a76f-974428feba70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b] added
Aug 16 18:15:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9668a242-505c-491d-9fa6-09bdb96c6057]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ddf90b-50fa-4138-aafa-47461efb50f0]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nZsMwdac {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nZsMwdac" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72243287-063d-4af5-95dc-649dc126e973]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nZsMwdac'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f4cad5-041d-461a-a738-d54f48b78c20]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0d1ef3-e128-42e5-bb72-3eac598ab96f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:49 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:15:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:49 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:15:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cfe2ba-a63d-4339-a3a8-f9fa42891b3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b, portal: 172.16.0.220,3260]
Aug 16 18:15:49 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b, portal: 172.16.0.220,3260] successful.
Aug 16 18:15:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddfba2f-a2d1-465a-b065-ad0589cc22eb]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81d74b0-cfbf-4af3-9abc-8d65091826c2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:49 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:15:49 user nova-compute[72000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b (non-flash)
Aug 16 18:15:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:49 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:15:49 user nova-compute[72000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b (non-flash)
Aug 16 18:15:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[98478267-bad8-43d5-9879-ae103f40a16f]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:49 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:15:50 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:15:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZsMwdac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:15:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:15:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23762363830643637', 'path': '/dev/sdd'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:15:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762363830643637', 'path': '/dev/sdd'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:15:50 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'flavor' on Instance uuid 618b087f-3794-4508-bc46-a30f888525ec {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:15:50 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:15:50 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:15:50 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:15:50 user nova-compute[72000]:   <serial>5274fa18-7d3f-4ffe-9f7b-af97417d0e1b</serial>
Aug 16 18:15:50 user nova-compute[72000]: </disk>
Aug 16 18:15:50 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:15:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:15:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:15:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] No VIF found with MAC fa:16:3e:69:b7:01, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:15:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0588fed5-7cba-4da8-afce-500798c03ad1 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.409s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-b52967d3-e332-4d0d-8aa7-46d0ff71ca58 req-e112cfb9-eeca-47a3-a60c-e8e272696d4a service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-changed-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-b52967d3-e332-4d0d-8aa7-46d0ff71ca58 req-e112cfb9-eeca-47a3-a60c-e8e272696d4a service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Refreshing instance network info cache due to event network-changed-8a0ca71d-a462-47fa-85e8-6c689315db09. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:15:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b52967d3-e332-4d0d-8aa7-46d0ff71ca58 req-e112cfb9-eeca-47a3-a60c-e8e272696d4a service nova] Acquiring lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:15:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b52967d3-e332-4d0d-8aa7-46d0ff71ca58 req-e112cfb9-eeca-47a3-a60c-e8e272696d4a service nova] Acquired lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:15:51 user nova-compute[72000]: DEBUG nova.network.neutron [req-b52967d3-e332-4d0d-8aa7-46d0ff71ca58 req-e112cfb9-eeca-47a3-a60c-e8e272696d4a service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Refreshing network info cache for port 8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:15:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-b52967d3-e332-4d0d-8aa7-46d0ff71ca58 req-e112cfb9-eeca-47a3-a60c-e8e272696d4a service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updated VIF entry in instance network info cache for port 8a0ca71d-a462-47fa-85e8-6c689315db09. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:15:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-b52967d3-e332-4d0d-8aa7-46d0ff71ca58 req-e112cfb9-eeca-47a3-a60c-e8e272696d4a service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updating instance_info_cache with network_info: [{"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:15:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b52967d3-e332-4d0d-8aa7-46d0ff71ca58 req-e112cfb9-eeca-47a3-a60c-e8e272696d4a service nova] Releasing lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:15:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:53 user nova-compute[72000]: INFO nova.compute.manager [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Detaching volume 5274fa18-7d3f-4ffe-9f7b-af97417d0e1b
Aug 16 18:15:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-08059f77-018d-4c03-8ba9-0313eea404ed req-9abedc2e-7f6a-4063-ad68-86d1b63151d3 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received event network-changed-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-08059f77-018d-4c03-8ba9-0313eea404ed req-9abedc2e-7f6a-4063-ad68-86d1b63151d3 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Refreshing instance network info cache due to event network-changed-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:15:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-08059f77-018d-4c03-8ba9-0313eea404ed req-9abedc2e-7f6a-4063-ad68-86d1b63151d3 service nova] Acquiring lock "refresh_cache-04c75ec7-92c4-4130-8846-e867dd5384c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:15:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-08059f77-018d-4c03-8ba9-0313eea404ed req-9abedc2e-7f6a-4063-ad68-86d1b63151d3 service nova] Acquired lock "refresh_cache-04c75ec7-92c4-4130-8846-e867dd5384c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:15:53 user nova-compute[72000]: DEBUG nova.network.neutron [req-08059f77-018d-4c03-8ba9-0313eea404ed req-9abedc2e-7f6a-4063-ad68-86d1b63151d3 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Refreshing network info cache for port 83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:15:53 user nova-compute[72000]: INFO nova.virt.block_device [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Attempting to driver detach volume 5274fa18-7d3f-4ffe-9f7b-af97417d0e1b from mountpoint /dev/vdb
Aug 16 18:15:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Attempting to detach device vdb from instance 618b087f-3794-4508-bc46-a30f888525ec from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:15:54 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:15:54 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:15:54 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:15:54 user nova-compute[72000]:   <serial>5274fa18-7d3f-4ffe-9f7b-af97417d0e1b</serial>
Aug 16 18:15:54 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:15:54 user nova-compute[72000]: </disk>
Aug 16 18:15:54 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:15:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Successfully detached device vdb from instance 618b087f-3794-4508-bc46-a30f888525ec from the persistent domain config.
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 618b087f-3794-4508-bc46-a30f888525ec from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:15:54 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:15:54 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:15:54 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:15:54 user nova-compute[72000]:   <serial>5274fa18-7d3f-4ffe-9f7b-af97417d0e1b</serial>
Aug 16 18:15:54 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:15:54 user nova-compute[72000]: </disk>
Aug 16 18:15:54 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lazy-loading 'flavor' on Instance uuid 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:54 user nova-compute[72000]: INFO nova.compute.manager [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Attaching volume d19dc181-5320-4040-8d40-c87b49b754d0 to /dev/vdb
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.utils [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34ced8f-3e54-4758-b789-3ce7cc024a0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7fb7bb-acb0-4afe-9c3d-4e1fe6f3af88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[61274bca-1450-493f-b49f-f227995d7c89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a8989d-6d5b-43fa-be72-0f1d4fc94710]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:15:54 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a176ce3-d066-49bd-8e44-02bb23b137a4]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.utils [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Updating existing volume attachment record: 71a13f56-1612-417c-bed6-818a82d91350 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209754.4494393, 618b087f-3794-4508-bc46-a30f888525ec => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 618b087f-3794-4508-bc46-a30f888525ec {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:15:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Successfully detached device vdb from instance 618b087f-3794-4508-bc46-a30f888525ec from the live domain config.
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZsMwdac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:15:54 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aa5f8d-1712-4514-82df-8158d7a13928]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.network.neutron [req-08059f77-018d-4c03-8ba9-0313eea404ed req-9abedc2e-7f6a-4063-ad68-86d1b63151d3 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Updated VIF entry in instance network info cache for port 83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.network.neutron [req-08059f77-018d-4c03-8ba9-0313eea404ed req-9abedc2e-7f6a-4063-ad68-86d1b63151d3 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Updating instance_info_cache with network_info: [{"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a54dc6-90a2-4a3e-ad70-c0911d8caac6]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:54 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:15:54 user nova-compute[72000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b (non-flash)
Aug 16 18:15:54 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:15:54 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:15:54 user nova-compute[72000]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b (non-flash)
Aug 16 18:15:54 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01056d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b'): ({'sdd'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Removing single pathed devices sdd {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-08059f77-018d-4c03-8ba9-0313eea404ed req-9abedc2e-7f6a-4063-ad68-86d1b63151d3 service nova] Releasing lock "refresh_cache-04c75ec7-92c4-4130-8846-e867dd5384c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b862ded-8142-44b6-ae19-48f3c027ede6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcc256b-252c-421f-8829-70a0a0a7a0c9]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Flushing IO for device /dev/sdd {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3042c5-b7ce-436a-be13-346de6e87626]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[475dd2b1-6aaa-48f1-acef-796e3cb762d7]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[926affa8-f1d2-4b09-abd7-e3e15df6f4bd]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[93596a21-5f58-46a3-8cce-f842ecaf50fa]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b, portal: 172.16.0.220,3260]
Aug 16 18:15:54 user nova-compute[72000]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b, portal: 172.16.0.220,3260] successful.
Aug 16 18:15:54 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5274fa18-7d3f-4ffe-9f7b-af97417d0e1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe895374-7d49-424f-8eaf-d31990dafd7c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] <== disconnect_volume: return (281ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:15:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:15:55 user nova-compute[72000]: DEBUG nova.objects.instance [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'flavor' on Instance uuid 618b087f-3794-4508-bc46-a30f888525ec {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:15:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-29670f00-10fd-48ca-a86e-6041c6484e76 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:56 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209741.8600821, 89561a1c-6fae-4ded-865b-d338e86e40d8 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:15:56 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] VM Stopped (Lifecycle Event)
Aug 16 18:15:56 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f1ac745d-c424-4656-8a34-33a63a2faa6a None None] [instance: 89561a1c-6fae-4ded-865b-d338e86e40d8] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:15:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:57 user nova-compute[72000]: INFO nova.compute.manager [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Shelving
Aug 16 18:15:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:58 user nova-compute[72000]: DEBUG nova.compute.manager [req-e485a36f-51c8-4792-b88a-695c0de37097 req-7eb989f5-bf31-4dc2-bdb5-d97b9a376e11 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-vif-unplugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:15:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e485a36f-51c8-4792-b88a-695c0de37097 req-7eb989f5-bf31-4dc2-bdb5-d97b9a376e11 service nova] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:15:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e485a36f-51c8-4792-b88a-695c0de37097 req-7eb989f5-bf31-4dc2-bdb5-d97b9a376e11 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:15:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e485a36f-51c8-4792-b88a-695c0de37097 req-7eb989f5-bf31-4dc2-bdb5-d97b9a376e11 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:15:58 user nova-compute[72000]: DEBUG nova.compute.manager [req-e485a36f-51c8-4792-b88a-695c0de37097 req-7eb989f5-bf31-4dc2-bdb5-d97b9a376e11 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] No waiting events found dispatching network-vif-unplugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:15:58 user nova-compute[72000]: WARNING nova.compute.manager [req-e485a36f-51c8-4792-b88a-695c0de37097 req-7eb989f5-bf31-4dc2-bdb5-d97b9a376e11 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received unexpected event network-vif-unplugged-8a0ca71d-a462-47fa-85e8-6c689315db09 for instance with vm_state active and task_state shelving.
Aug 16 18:15:58 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance destroyed successfully.
Aug 16 18:15:58 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Beginning cold snapshot process
Aug 16 18:15:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:15:58 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:15:58 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk /opt/stack/data/nova/instances/snapshots/tmpx674s4mj/ae32f887153344db8b2d0bf227948cd3 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:15:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk /opt/stack/data/nova/instances/snapshots/tmpx674s4mj/ae32f887153344db8b2d0bf227948cd3" returned: 0 in 0.321s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:15:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Snapshot extracted, beginning image upload
Aug 16 18:16:00 user nova-compute[72000]: DEBUG nova.compute.manager [req-dca41039-ce83-4591-b40a-efbc64947884 req-654e4958-63b8-43fc-9241-509a59e77327 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:16:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dca41039-ce83-4591-b40a-efbc64947884 req-654e4958-63b8-43fc-9241-509a59e77327 service nova] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dca41039-ce83-4591-b40a-efbc64947884 req-654e4958-63b8-43fc-9241-509a59e77327 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dca41039-ce83-4591-b40a-efbc64947884 req-654e4958-63b8-43fc-9241-509a59e77327 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:00 user nova-compute[72000]: DEBUG nova.compute.manager [req-dca41039-ce83-4591-b40a-efbc64947884 req-654e4958-63b8-43fc-9241-509a59e77327 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] No waiting events found dispatching network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:16:00 user nova-compute[72000]: WARNING nova.compute.manager [req-dca41039-ce83-4591-b40a-efbc64947884 req-654e4958-63b8-43fc-9241-509a59e77327 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received unexpected event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 for instance with vm_state active and task_state shelving_image_uploading.
Aug 16 18:16:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Snapshot image upload complete
Aug 16 18:16:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:16:01 user nova-compute[72000]: INFO nova.compute.manager [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Shelve offloading
Aug 16 18:16:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance destroyed successfully.
Aug 16 18:16:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:16:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:16:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquired lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:16:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:16:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updating instance_info_cache with network_info: [{"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:16:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Releasing lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:16:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance destroyed successfully.
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'resources' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760819973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760819973',id=28,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL49CVt0Uq3olYK6lvp81M2OQr9EqGjZdkLgJJ/s+UcDWuE8BakkFDT59JWIXrQxn0Heygnh4BjsCmzFS1CDTkv9tenYbDAE3rcHIAIOvWaVWE7hH35uLXG71q+MS9xu2Q==',key_name='tempest-keypair-562308264',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-jnf2nb8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member',shelved_at='2023-08-16T18:16:01.749056',shelved_host='user',shelved_image_id='a78c4226-f222-46d8-a644-bb3e1132f60f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:15:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG os_vif [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a0ca71d-a4, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:16:03 user nova-compute[72000]: INFO os_vif [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4')
Aug 16 18:16:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Deleting instance files /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34_del
Aug 16 18:16:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Deletion of /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34_del complete
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-d1ebff32-e94f-4ec1-9021-9ad740ef2696 req-6252e898-b634-46d8-8549-6fd3149dddc3 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-changed-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-d1ebff32-e94f-4ec1-9021-9ad740ef2696 req-6252e898-b634-46d8-8549-6fd3149dddc3 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Refreshing instance network info cache due to event network-changed-8a0ca71d-a462-47fa-85e8-6c689315db09. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d1ebff32-e94f-4ec1-9021-9ad740ef2696 req-6252e898-b634-46d8-8549-6fd3149dddc3 service nova] Acquiring lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d1ebff32-e94f-4ec1-9021-9ad740ef2696 req-6252e898-b634-46d8-8549-6fd3149dddc3 service nova] Acquired lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-d1ebff32-e94f-4ec1-9021-9ad740ef2696 req-6252e898-b634-46d8-8549-6fd3149dddc3 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Refreshing network info cache for port 8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:16:03 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Deleted allocations for instance 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34
Aug 16 18:16:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'numa_topology' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-d1ebff32-e94f-4ec1-9021-9ad740ef2696 req-6252e898-b634-46d8-8549-6fd3149dddc3 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updated VIF entry in instance network info cache for port 8a0ca71d-a462-47fa-85e8-6c689315db09. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-d1ebff32-e94f-4ec1-9021-9ad740ef2696 req-6252e898-b634-46d8-8549-6fd3149dddc3 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updating instance_info_cache with network_info: [{"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d1ebff32-e94f-4ec1-9021-9ad740ef2696 req-6252e898-b634-46d8-8549-6fd3149dddc3 service nova] Releasing lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:16:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f441446f-7642-4f57-9e5d-b2995db0f685 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.072s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GcvtzIsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:16:05 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:16:05 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:16:05 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64b68bb-268d-4648-8786-76bde32e5461]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:16:05 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[189bdde8-5412-4300-be8e-8d3714a6af05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0] added
Aug 16 18:16:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[89131499-0772-40f9-90c3-3211611752b0]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b0373f-3043-4d1c-bb60-649915808706]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GcvtzIsO {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GcvtzIsO" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f1ac8-7087-4856-9ee0-bace734b7674]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GcvtzIsO'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad61558e-e604-46c1-8d52-69207700e218]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c635b7-fb2f-48e1-986e-861aaa54114e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:16:05 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:16:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:16:05 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:16:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df3824d-6b40-4e25-801f-178836da411d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0, portal: 172.16.0.220,3260]
Aug 16 18:16:05 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0, portal: 172.16.0.220,3260] successful.
Aug 16 18:16:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[63431387-617b-482b-aab0-2b176123a3c7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f53b2c3-38f5-422c-85b4-0acd120d5bd6]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:16:05 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:16:05 user nova-compute[72000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)
Aug 16 18:16:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:16:05 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:16:05 user nova-compute[72000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)
Aug 16 18:16:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcc8f3f-3cbe-4ca8-b0dd-5b130219801b]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:16:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:16:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GcvtzIsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:16:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:16:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23733646261376134', 'path': '/dev/sdd'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:16:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733646261376134', 'path': '/dev/sdd'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:16:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lazy-loading 'flavor' on Instance uuid 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:16:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:16:06 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:16:06 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:16:06 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:16:06 user nova-compute[72000]:   <serial>d19dc181-5320-4040-8d40-c87b49b754d0</serial>
Aug 16 18:16:06 user nova-compute[72000]: </disk>
Aug 16 18:16:06 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:16:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:16:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:16:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] No VIF found with MAC fa:16:3e:14:4e:22, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:16:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-08efd92e-84f3-475c-8340-47a81389a019 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.832s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG nova.objects.instance [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lazy-loading 'flavor' on Instance uuid 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:10 user nova-compute[72000]: INFO nova.compute.manager [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Attaching volume 3c867bee-66a1-49e7-9e06-fa809e13bb65 to /dev/vdc
Aug 16 18:16:10 user nova-compute[72000]: DEBUG os_brick.utils [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b2354f-688d-457f-af88-b25a3e9393e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd6e4ec-9785-4f85-9b09-28d4fef079bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[52392977-1753-4bd1-8d69-5196319b1417]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[15891ea5-241d-4d20-af78-d98557592a55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:16:10 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:16:10 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a94096-3f15-41e7-8ca0-a0614165080c]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG os_brick.utils [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:16:10 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Updating existing volume attachment record: 4f79261d-5e09-4ce3-abfc-cacc8a95a113 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:16:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:13 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209758.6024382, 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:16:13 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] VM Stopped (Lifecycle Event)
Aug 16 18:16:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-195d5c1c-6802-4648-8660-09a51ce6e72f None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:16:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuPaWsVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:16:20 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:16:20 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:16:20 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa079dc2-cda6-4186-98e5-0e30cdf8451a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:16:20 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e745a2d-ca49-457f-8c11-59a733507409]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65] added
Aug 16 18:16:20 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0264c575-04fa-40f3-b614-66ca88e0d396]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d6b6eb-bd55-438e-89c9-69d1a5dae8c7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vuPaWsVm {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vuPaWsVm" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19335d45-f7f6-4027-a3ac-5ff6346add93]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vuPaWsVm'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d6915e-c058-488f-bdd0-05a68841aa8c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b286ffeb-4329-4e27-b430-fa45485b5c34]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:16:20 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:16:20 user nova-compute[72000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)
Aug 16 18:16:20 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:16:20 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:16:20 user nova-compute[72000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)
Aug 16 18:16:20 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[510e90f1-b8a7-4bcf-b1d6-5c145c2f30f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65, portal: 172.16.0.220,3260]
Aug 16 18:16:20 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65, portal: 172.16.0.220,3260] successful.
Aug 16 18:16:20 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[defd2d06-9bb0-4196-a80b-ccd62d2ee1fa]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1939ad5f-80c3-47c1-abfb-a3263a7c8b81]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:16:21 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:16:21 user nova-compute[72000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)
Aug 16 18:16:21 user nova-compute[72000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 (non-flash)
Aug 16 18:16:21 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:16:21 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:16:21 user nova-compute[72000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)
Aug 16 18:16:21 user nova-compute[72000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 (non-flash)
Aug 16 18:16:21 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9577192e-2046-400b-9994-4ab53b740e16]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuPaWsVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23661356536373236', 'path': '/dev/sde'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661356536373236', 'path': '/dev/sde'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG nova.objects.instance [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lazy-loading 'flavor' on Instance uuid 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:16:22 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:16:22 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:16:22 user nova-compute[72000]:   <target dev="vdc" bus="virtio"/>
Aug 16 18:16:22 user nova-compute[72000]:   <serial>3c867bee-66a1-49e7-9e06-fa809e13bb65</serial>
Aug 16 18:16:22 user nova-compute[72000]: </disk>
Aug 16 18:16:22 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] No VIF found with MAC fa:16:3e:14:4e:22, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dbae41f9-101c-4319-a399-ec5fd30ad8d0 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.424s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:16:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Updating instance_info_cache with network_info: [{"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-966d4480-7413-43bc-9b0f-6a522e88908b" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:23 user nova-compute[72000]: INFO nova.compute.manager [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Detaching volume 3c867bee-66a1-49e7-9e06-fa809e13bb65
Aug 16 18:16:23 user nova-compute[72000]: INFO nova.virt.block_device [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Attempting to driver detach volume 3c867bee-66a1-49e7-9e06-fa809e13bb65 from mountpoint /dev/vdc
Aug 16 18:16:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Attempting to detach device vdc from instance 04c75ec7-92c4-4130-8846-e867dd5384c4 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:16:23 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:16:23 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:16:23 user nova-compute[72000]:   <target dev="vdc" bus="virtio"/>
Aug 16 18:16:23 user nova-compute[72000]:   <serial>3c867bee-66a1-49e7-9e06-fa809e13bb65</serial>
Aug 16 18:16:23 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 18:16:23 user nova-compute[72000]: </disk>
Aug 16 18:16:23 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:16:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Successfully detached device vdc from instance 04c75ec7-92c4-4130-8846-e867dd5384c4 from the persistent domain config.
Aug 16 18:16:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 04c75ec7-92c4-4130-8846-e867dd5384c4 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:16:23 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:16:23 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:16:23 user nova-compute[72000]:   <target dev="vdc" bus="virtio"/>
Aug 16 18:16:23 user nova-compute[72000]:   <serial>3c867bee-66a1-49e7-9e06-fa809e13bb65</serial>
Aug 16 18:16:23 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 16 18:16:23 user nova-compute[72000]: </disk>
Aug 16 18:16:23 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209783.9277987, 04c75ec7-92c4-4130-8846-e867dd5384c4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:16:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Successfully detached device vdc from instance 04c75ec7-92c4-4130-8846-e867dd5384c4 from the live domain config.
Aug 16 18:16:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuPaWsVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:16:23 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:16:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[662b1501-f54d-44f8-b5a2-f5a6bf139bed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2078041-2656-4fca-8e5c-0ce3100943b1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:16:23 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:16:23 user nova-compute[72000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)
Aug 16 18:16:23 user nova-compute[72000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 (non-flash)
Aug 16 18:16:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:16:23 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:16:23 user nova-compute[72000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)
Aug 16 18:16:23 user nova-compute[72000]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 (non-flash)
Aug 16 18:16:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd00878d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65'): ({'sde'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Removing single pathed devices sde {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2802cd-29d3-45a2-9e35-50280844fb1a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a8d43a-35b4-4ab6-abad-bcd01168bf09]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Flushing IO for device /dev/sde {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb90dfa6-31b5-4288-b199-c6202538e816]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdfcfda-9150-4530-a8f7-f4ef0fedb229]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6e1d33-89a8-466d-bc0f-99022339cfdb]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b043e73-d6db-4e49-8e36-c4907f92a016]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65, portal: 172.16.0.220,3260]
Aug 16 18:16:24 user nova-compute[72000]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65, portal: 172.16.0.220,3260] successful.
Aug 16 18:16:24 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c867bee-66a1-49e7-9e06-fa809e13bb65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90027168-e1f3-4bb7-8df1-b540f54cab81]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] <== disconnect_volume: return (300ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG nova.objects.instance [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lazy-loading 'flavor' on Instance uuid 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-63d2f60c-18fd-40dc-9c29-b4832b15c79b tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.690s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:16:29 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:16:29 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:16:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7543MB free_disk=23.57595443725586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:16:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 618b087f-3794-4508-bc46-a30f888525ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 04c75ec7-92c4-4130-8846-e867dd5384c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance ca0dfc09-f74e-4237-8759-a46b1842ee85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.709s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:16:30 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:16:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:16:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:40 user nova-compute[72000]: INFO nova.compute.manager [None req-fb12e5fc-1e9a-49a0-8248-384fe835e809 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Unrescuing
Aug 16 18:16:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fb12e5fc-1e9a-49a0-8248-384fe835e809 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:16:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fb12e5fc-1e9a-49a0-8248-384fe835e809 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquired lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:16:40 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fb12e5fc-1e9a-49a0-8248-384fe835e809 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fb12e5fc-1e9a-49a0-8248-384fe835e809 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updating instance_info_cache with network_info: [{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fb12e5fc-1e9a-49a0-8248-384fe835e809 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Releasing lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG nova.objects.instance [None req-fb12e5fc-1e9a-49a0-8248-384fe835e809 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'flavor' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-730f351b-ab47-4309-9cb8-e1b63393f488 req-2704cc6d-c65b-4e68-92e7-2afc257ef341 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-unplugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-730f351b-ab47-4309-9cb8-e1b63393f488 req-2704cc6d-c65b-4e68-92e7-2afc257ef341 service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-730f351b-ab47-4309-9cb8-e1b63393f488 req-2704cc6d-c65b-4e68-92e7-2afc257ef341 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-730f351b-ab47-4309-9cb8-e1b63393f488 req-2704cc6d-c65b-4e68-92e7-2afc257ef341 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-730f351b-ab47-4309-9cb8-e1b63393f488 req-2704cc6d-c65b-4e68-92e7-2afc257ef341 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-unplugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:16:41 user nova-compute[72000]: WARNING nova.compute.manager [req-730f351b-ab47-4309-9cb8-e1b63393f488 req-2704cc6d-c65b-4e68-92e7-2afc257ef341 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-unplugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:16:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-0b5185f5-1fe7-425b-ad7a-d00c81e4b76d req-a6f70078-5dd9-4f03-bc16-ff0e79a5b19a service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-changed-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:16:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-0b5185f5-1fe7-425b-ad7a-d00c81e4b76d req-a6f70078-5dd9-4f03-bc16-ff0e79a5b19a service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Refreshing instance network info cache due to event network-changed-52283d99-7220-49dd-92cd-8489ee426bc1. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:16:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0b5185f5-1fe7-425b-ad7a-d00c81e4b76d req-a6f70078-5dd9-4f03-bc16-ff0e79a5b19a service nova] Acquiring lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:16:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0b5185f5-1fe7-425b-ad7a-d00c81e4b76d req-a6f70078-5dd9-4f03-bc16-ff0e79a5b19a service nova] Acquired lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:16:42 user nova-compute[72000]: DEBUG nova.network.neutron [req-0b5185f5-1fe7-425b-ad7a-d00c81e4b76d req-a6f70078-5dd9-4f03-bc16-ff0e79a5b19a service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Refreshing network info cache for port 52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:16:42 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Instance destroyed successfully.
Aug 16 18:16:42 user nova-compute[72000]: DEBUG nova.network.neutron [req-0b5185f5-1fe7-425b-ad7a-d00c81e4b76d req-a6f70078-5dd9-4f03-bc16-ff0e79a5b19a service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updated VIF entry in instance network info cache for port 52283d99-7220-49dd-92cd-8489ee426bc1. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:16:42 user nova-compute[72000]: DEBUG nova.network.neutron [req-0b5185f5-1fe7-425b-ad7a-d00c81e4b76d req-a6f70078-5dd9-4f03-bc16-ff0e79a5b19a service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updating instance_info_cache with network_info: [{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:16:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0b5185f5-1fe7-425b-ad7a-d00c81e4b76d req-a6f70078-5dd9-4f03-bc16-ff0e79a5b19a service nova] Releasing lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-36d92b61-dec8-48b7-86d0-1366d96ae09e req-8e9f28f2-93da-43f7-abb9-3316f8922134 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36d92b61-dec8-48b7-86d0-1366d96ae09e req-8e9f28f2-93da-43f7-abb9-3316f8922134 service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36d92b61-dec8-48b7-86d0-1366d96ae09e req-8e9f28f2-93da-43f7-abb9-3316f8922134 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36d92b61-dec8-48b7-86d0-1366d96ae09e req-8e9f28f2-93da-43f7-abb9-3316f8922134 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-36d92b61-dec8-48b7-86d0-1366d96ae09e req-8e9f28f2-93da-43f7-abb9-3316f8922134 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:16:43 user nova-compute[72000]: WARNING nova.compute.manager [req-36d92b61-dec8-48b7-86d0-1366d96ae09e req-8e9f28f2-93da-43f7-abb9-3316f8922134 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:16:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-19b8290f-4f00-4e9b-8ecf-092c8af61725 req-f6bb158f-5f07-4967-9611-c343f757e1ee service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-changed-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-19b8290f-4f00-4e9b-8ecf-092c8af61725 req-f6bb158f-5f07-4967-9611-c343f757e1ee service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Refreshing instance network info cache due to event network-changed-52283d99-7220-49dd-92cd-8489ee426bc1. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-19b8290f-4f00-4e9b-8ecf-092c8af61725 req-f6bb158f-5f07-4967-9611-c343f757e1ee service nova] Acquiring lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-19b8290f-4f00-4e9b-8ecf-092c8af61725 req-f6bb158f-5f07-4967-9611-c343f757e1ee service nova] Acquired lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG nova.network.neutron [req-19b8290f-4f00-4e9b-8ecf-092c8af61725 req-f6bb158f-5f07-4967-9611-c343f757e1ee service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Refreshing network info cache for port 52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG nova.network.neutron [req-19b8290f-4f00-4e9b-8ecf-092c8af61725 req-f6bb158f-5f07-4967-9611-c343f757e1ee service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updated VIF entry in instance network info cache for port 52283d99-7220-49dd-92cd-8489ee426bc1. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG nova.network.neutron [req-19b8290f-4f00-4e9b-8ecf-092c8af61725 req-f6bb158f-5f07-4967-9611-c343f757e1ee service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updating instance_info_cache with network_info: [{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:16:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-19b8290f-4f00-4e9b-8ecf-092c8af61725 req-f6bb158f-5f07-4967-9611-c343f757e1ee service nova] Releasing lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:16:45 user nova-compute[72000]: WARNING nova.compute.manager [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:16:45 user nova-compute[72000]: WARNING nova.compute.manager [req-47b6686b-64dd-45fd-a1c8-3a69500a5bbc req-1c6ffd2a-a9c2-4833-b34f-b462112352ca service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for 59b456c9-e5af-4e47-a2f1-ba4f35c8308a due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209805.8438568, 59b456c9-e5af-4e47-a2f1-ba4f35c8308a => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:16:45 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] VM Resumed (Lifecycle Event)
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fb12e5fc-1e9a-49a0-8248-384fe835e809 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:16:45 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209805.845724, 59b456c9-e5af-4e47-a2f1-ba4f35c8308a => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:16:45 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] VM Started (Lifecycle Event)
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:16:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:16:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:53 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:16:53 user nova-compute[72000]: INFO nova.compute.manager [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] instance snapshotting
Aug 16 18:16:53 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Beginning live snapshot process
Aug 16 18:16:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json -f qcow2 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json -f qcow2 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph85ho58t/a0e674c90c0147dabaab2a23966e7ba7.delta 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph85ho58t/a0e674c90c0147dabaab2a23966e7ba7.delta 1073741824" returned: 0 in 0.052s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 18:16:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:16:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:16:55 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 18:16:55 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:16:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph85ho58t/a0e674c90c0147dabaab2a23966e7ba7.delta /opt/stack/data/nova/instances/snapshots/tmph85ho58t/a0e674c90c0147dabaab2a23966e7ba7 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:16:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph85ho58t/a0e674c90c0147dabaab2a23966e7ba7.delta /opt/stack/data/nova/instances/snapshots/tmph85ho58t/a0e674c90c0147dabaab2a23966e7ba7" returned: 0 in 0.454s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:16:56 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Snapshot extracted, beginning image upload
Aug 16 18:16:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:58 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Snapshot image upload complete
Aug 16 18:16:58 user nova-compute[72000]: INFO nova.compute.manager [None req-d7607bf7-fe53-4de3-bc35-ce778e764442 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Took 5.07 seconds to snapshot the instance on the hypervisor.
Aug 16 18:16:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:16:59 user nova-compute[72000]: WARNING nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Aug 16 18:16:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 618b087f-3794-4508-bc46-a30f888525ec {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid ca0dfc09-f74e-4237-8759-a46b1842ee85 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "966d4480-7413-43bc-9b0f-6a522e88908b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "618b087f-3794-4508-bc46-a30f888525ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "966d4480-7413-43bc-9b0f-6a522e88908b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "618b087f-3794-4508-bc46-a30f888525ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:16:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:17:00 user nova-compute[72000]: INFO nova.compute.claims [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Claim successful on node user
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:17:00 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.policy [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bce14217bd604140a4082ca9f6b862c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6fe73c2955b4eddbbfd84bd9806ba88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:17:00 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Creating image(s)
Aug 16 18:17:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "/opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "/opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "/opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "1339dc4f72f5db75633124199a4c7a0e9a7810f4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "1339dc4f72f5db75633124199a4c7a0e9a7810f4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4.part --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4.part --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:01 user nova-compute[72000]: DEBUG nova.virt.images [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] 2ea78fd4-ae9f-46aa-928f-354f91b3acda was qcow2, converting to raw {{(pid=72000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 18:17:01 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:17:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4.part /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4.converted {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Successfully created port: f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4.part /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4.converted" returned: 0 in 0.257s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4.converted --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "1339dc4f72f5db75633124199a4c7a0e9a7810f4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.510s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4 --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "1339dc4f72f5db75633124199a4c7a0e9a7810f4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "1339dc4f72f5db75633124199a4c7a0e9a7810f4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Successfully updated port: f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4 --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4,backing_fmt=raw /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquired lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-cfe01328-ae17-48b6-898b-1f2e7a6ce74b req-99077418-ea90-4f62-a4e8-61ce8b8d4efb service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received event network-changed-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-cfe01328-ae17-48b6-898b-1f2e7a6ce74b req-99077418-ea90-4f62-a4e8-61ce8b8d4efb service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Refreshing instance network info cache due to event network-changed-f4bc585f-bb94-4901-a32c-c1d1b0549ed1. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:17:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cfe01328-ae17-48b6-898b-1f2e7a6ce74b req-99077418-ea90-4f62-a4e8-61ce8b8d4efb service nova] Acquiring lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4,backing_fmt=raw /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk 1073741824" returned: 0 in 0.274s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "1339dc4f72f5db75633124199a4c7a0e9a7810f4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.457s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4 --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'migration_context' on Instance uuid 6951079b-d2ca-41c3-9f4e-7090d13cb090 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Ensure instance console log exists: /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Updating instance_info_cache with network_info: [{"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Releasing lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Instance network_info: |[{"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cfe01328-ae17-48b6-898b-1f2e7a6ce74b req-99077418-ea90-4f62-a4e8-61ce8b8d4efb service nova] Acquired lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-cfe01328-ae17-48b6-898b-1f2e7a6ce74b req-99077418-ea90-4f62-a4e8-61ce8b8d4efb service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Refreshing network info cache for port f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Start _get_guest_xml network_info=[{"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8d1b1db81ef8a034e64613b9587b9d5a',container_format='bare',created_at=2023-08-16T18:16:53Z,direct_url=<?>,disk_format='qcow2',id=2ea78fd4-ae9f-46aa-928f-354f91b3acda,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1557254982',owner='c6fe73c2955b4eddbbfd84bd9806ba88',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T18:16:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '2ea78fd4-ae9f-46aa-928f-354f91b3acda'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:17:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:17:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8d1b1db81ef8a034e64613b9587b9d5a',container_format='bare',created_at=2023-08-16T18:16:53Z,direct_url=<?>,disk_format='qcow2',id=2ea78fd4-ae9f-46aa-928f-354f91b3acda,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1557254982',owner='c6fe73c2955b4eddbbfd84bd9806ba88',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T18:16:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2139753412',display_name='tempest-TestStampPattern-server-2139753412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2139753412',id=31,image_ref='2ea78fd4-ae9f-46aa-928f-354f91b3acda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnL9X6wz3GwRD3jGjdqTIwmD/7nKpA3bWQ1ZIEuWHKZC1VpFYkzRFXTP/yQJ9fYNYYuFbJpkSkCeUgHRnAHArKDMODurNq3Vj+iMZJqARRn9GQICSStCAl47V2JXBmY1g==',key_name='tempest-TestStampPattern-2099348715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fe73c2955b4eddbbfd84bd9806ba88',ramdisk_id='',reservation_id='r-j05al0gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='618b087f-3794-4508-bc46-a30f888525ec',image_min_disk='1',image_min_ram='0',image_owner_id='c6fe73c2955b4eddbbfd84bd9806ba88',image_owner_project_name='tempest-TestStampPattern-463262942',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-463262942-project-member',image_user_id='bce14217bd604140a4082ca9f6b862c0',network_allocated='True',owner_project_name='tempest-TestStampPattern-463262942',owner_user_name='tempest-TestStampPattern-463262942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:17:01Z,user_data=None,user_id='bce14217bd604140a4082ca9f6b862c0',uuid=6951079b-d2ca-41c3-9f4e-7090d13cb090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converting VIF {"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f2:f6,bridge_name='br-int',has_traffic_filtering=True,id=f4bc585f-bb94-4901-a32c-c1d1b0549ed1,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bc585f-bb') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'pci_devices' on Instance uuid 6951079b-d2ca-41c3-9f4e-7090d13cb090 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:17:03 user nova-compute[72000]:   <uuid>6951079b-d2ca-41c3-9f4e-7090d13cb090</uuid>
Aug 16 18:17:03 user nova-compute[72000]:   <name>instance-0000001f</name>
Aug 16 18:17:03 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:17:03 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:17:03 user nova-compute[72000]:   <metadata>
Aug 16 18:17:03 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:17:03 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:17:03 user nova-compute[72000]:       <nova:name>tempest-TestStampPattern-server-2139753412</nova:name>
Aug 16 18:17:03 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:17:03</nova:creationTime>
Aug 16 18:17:03 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:17:03 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:17:03 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:17:03 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:17:03 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:17:03 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:17:03 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:17:03 user nova-compute[72000]:       <nova:owner>
Aug 16 18:17:03 user nova-compute[72000]:         <nova:user uuid="bce14217bd604140a4082ca9f6b862c0">tempest-TestStampPattern-463262942-project-member</nova:user>
Aug 16 18:17:03 user nova-compute[72000]:         <nova:project uuid="c6fe73c2955b4eddbbfd84bd9806ba88">tempest-TestStampPattern-463262942</nova:project>
Aug 16 18:17:03 user nova-compute[72000]:       </nova:owner>
Aug 16 18:17:03 user nova-compute[72000]:       <nova:root type="image" uuid="2ea78fd4-ae9f-46aa-928f-354f91b3acda"/>
Aug 16 18:17:03 user nova-compute[72000]:       <nova:ports>
Aug 16 18:17:03 user nova-compute[72000]:         <nova:port uuid="f4bc585f-bb94-4901-a32c-c1d1b0549ed1">
Aug 16 18:17:03 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 18:17:03 user nova-compute[72000]:         </nova:port>
Aug 16 18:17:03 user nova-compute[72000]:       </nova:ports>
Aug 16 18:17:03 user nova-compute[72000]:     </nova:instance>
Aug 16 18:17:03 user nova-compute[72000]:   </metadata>
Aug 16 18:17:03 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:17:03 user nova-compute[72000]:     <system>
Aug 16 18:17:03 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:17:03 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:17:03 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:17:03 user nova-compute[72000]:       <entry name="serial">6951079b-d2ca-41c3-9f4e-7090d13cb090</entry>
Aug 16 18:17:03 user nova-compute[72000]:       <entry name="uuid">6951079b-d2ca-41c3-9f4e-7090d13cb090</entry>
Aug 16 18:17:03 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:17:03 user nova-compute[72000]:     </system>
Aug 16 18:17:03 user nova-compute[72000]:   </sysinfo>
Aug 16 18:17:03 user nova-compute[72000]:   <os>
Aug 16 18:17:03 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:17:03 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:17:03 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:17:03 user nova-compute[72000]:   </os>
Aug 16 18:17:03 user nova-compute[72000]:   <features>
Aug 16 18:17:03 user nova-compute[72000]:     <acpi/>
Aug 16 18:17:03 user nova-compute[72000]:     <apic/>
Aug 16 18:17:03 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:17:03 user nova-compute[72000]:   </features>
Aug 16 18:17:03 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:17:03 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:17:03 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:17:03 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:17:03 user nova-compute[72000]:   </clock>
Aug 16 18:17:03 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:17:03 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:17:03 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:17:03 user nova-compute[72000]:   </cpu>
Aug 16 18:17:03 user nova-compute[72000]:   <devices>
Aug 16 18:17:03 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:17:03 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:17:03 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk"/>
Aug 16 18:17:03 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:17:03 user nova-compute[72000]:     </disk>
Aug 16 18:17:03 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:17:03 user nova-compute[72000]:       <mac address="fa:16:3e:7f:f2:f6"/>
Aug 16 18:17:03 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:17:03 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:17:03 user nova-compute[72000]:       <target dev="tapf4bc585f-bb"/>
Aug 16 18:17:03 user nova-compute[72000]:     </interface>
Aug 16 18:17:03 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:17:03 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/console.log" append="off"/>
Aug 16 18:17:03 user nova-compute[72000]:     </serial>
Aug 16 18:17:03 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:17:03 user nova-compute[72000]:     <video>
Aug 16 18:17:03 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:17:03 user nova-compute[72000]:     </video>
Aug 16 18:17:03 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:17:03 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:17:03 user nova-compute[72000]:     </rng>
Aug 16 18:17:03 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:17:03 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:17:03 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:17:03 user nova-compute[72000]:     </memballoon>
Aug 16 18:17:03 user nova-compute[72000]:   </devices>
Aug 16 18:17:03 user nova-compute[72000]: </domain>
Aug 16 18:17:03 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2139753412',display_name='tempest-TestStampPattern-server-2139753412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2139753412',id=31,image_ref='2ea78fd4-ae9f-46aa-928f-354f91b3acda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnL9X6wz3GwRD3jGjdqTIwmD/7nKpA3bWQ1ZIEuWHKZC1VpFYkzRFXTP/yQJ9fYNYYuFbJpkSkCeUgHRnAHArKDMODurNq3Vj+iMZJqARRn9GQICSStCAl47V2JXBmY1g==',key_name='tempest-TestStampPattern-2099348715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6fe73c2955b4eddbbfd84bd9806ba88',ramdisk_id='',reservation_id='r-j05al0gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='618b087f-3794-4508-bc46-a30f888525ec',image_min_disk='1',image_min_ram='0',image_owner_id='c6fe73c2955b4eddbbfd84bd9806ba88',image_owner_project_name='tempest-TestStampPattern-463262942',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-463262942-project-member',image_user_id='bce14217bd604140a4082ca9f6b862c0',network_allocated='True',owner_project_name='tempest-TestStampPattern-463262942',owner_user_name='tempest-TestStampPattern-463262942-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:17:01Z,user_data=None,user_id='bce14217bd604140a4082ca9f6b862c0',uuid=6951079b-d2ca-41c3-9f4e-7090d13cb090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converting VIF {"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f2:f6,bridge_name='br-int',has_traffic_filtering=True,id=f4bc585f-bb94-4901-a32c-c1d1b0549ed1,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bc585f-bb') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG os_vif [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f2:f6,bridge_name='br-int',has_traffic_filtering=True,id=f4bc585f-bb94-4901-a32c-c1d1b0549ed1,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bc585f-bb') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4bc585f-bb, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4bc585f-bb, col_values=(('external_ids', {'iface-id': 'f4bc585f-bb94-4901-a32c-c1d1b0549ed1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:f2:f6', 'vm-uuid': '6951079b-d2ca-41c3-9f4e-7090d13cb090'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:03 user nova-compute[72000]: INFO os_vif [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f2:f6,bridge_name='br-int',has_traffic_filtering=True,id=f4bc585f-bb94-4901-a32c-c1d1b0549ed1,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bc585f-bb')
Aug 16 18:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:17:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] No VIF found with MAC fa:16:3e:7f:f2:f6, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:17:04 user nova-compute[72000]: DEBUG nova.network.neutron [req-cfe01328-ae17-48b6-898b-1f2e7a6ce74b req-99077418-ea90-4f62-a4e8-61ce8b8d4efb service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Updated VIF entry in instance network info cache for port f4bc585f-bb94-4901-a32c-c1d1b0549ed1. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:17:04 user nova-compute[72000]: DEBUG nova.network.neutron [req-cfe01328-ae17-48b6-898b-1f2e7a6ce74b req-99077418-ea90-4f62-a4e8-61ce8b8d4efb service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Updating instance_info_cache with network_info: [{"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cfe01328-ae17-48b6-898b-1f2e7a6ce74b req-99077418-ea90-4f62-a4e8-61ce8b8d4efb service nova] Releasing lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:17:05 user nova-compute[72000]: INFO nova.compute.claims [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Claim successful on node user
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-e8507819-d08e-4e2f-998c-fa9f9ecb48f5 req-de9e5238-5b6c-4df3-858b-419e1db19349 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received event network-vif-plugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e8507819-d08e-4e2f-998c-fa9f9ecb48f5 req-de9e5238-5b6c-4df3-858b-419e1db19349 service nova] Acquiring lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e8507819-d08e-4e2f-998c-fa9f9ecb48f5 req-de9e5238-5b6c-4df3-858b-419e1db19349 service nova] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e8507819-d08e-4e2f-998c-fa9f9ecb48f5 req-de9e5238-5b6c-4df3-858b-419e1db19349 service nova] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-e8507819-d08e-4e2f-998c-fa9f9ecb48f5 req-de9e5238-5b6c-4df3-858b-419e1db19349 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] No waiting events found dispatching network-vif-plugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:05 user nova-compute[72000]: WARNING nova.compute.manager [req-e8507819-d08e-4e2f-998c-fa9f9ecb48f5 req-de9e5238-5b6c-4df3-858b-419e1db19349 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received unexpected event network-vif-plugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 for instance with vm_state building and task_state spawning.
Aug 16 18:17:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.network.neutron [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:17:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.policy [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e80d9a8665e34853897db6bd52e55b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '502f251cf3c6455cb4f5beb33be18cce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:17:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Creating image(s)
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "/opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "/opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk 1073741824" returned: 0 in 0.049s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG nova.network.neutron [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Successfully created port: 744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Cannot resize image /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'migration_context' on Instance uuid 8cc7305c-fadd-4b61-8a34-1bfa31f3277c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Ensure instance console log exists: /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Successfully updated port: 744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209827.249275, 6951079b-d2ca-41c3-9f4e-7090d13cb090 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:17:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] VM Resumed (Lifecycle Event)
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "refresh_cache-8cc7305c-fadd-4b61-8a34-1bfa31f3277c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquired lock "refresh_cache-8cc7305c-fadd-4b61-8a34-1bfa31f3277c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:17:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Instance spawned successfully.
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-300efa4e-9d0e-4013-8822-ee6782a32c8b req-b63e8cd5-8793-4c5d-8f0f-f037436a03aa service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received event network-changed-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-300efa4e-9d0e-4013-8822-ee6782a32c8b req-b63e8cd5-8793-4c5d-8f0f-f037436a03aa service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Refreshing instance network info cache due to event network-changed-744d8e3a-4406-4ccf-b1df-fb38dc285f05. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-300efa4e-9d0e-4013-8822-ee6782a32c8b req-b63e8cd5-8793-4c5d-8f0f-f037436a03aa service nova] Acquiring lock "refresh_cache-8cc7305c-fadd-4b61-8a34-1bfa31f3277c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:17:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209827.2515388, 6951079b-d2ca-41c3-9f4e-7090d13cb090 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:17:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] VM Started (Lifecycle Event)
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-a4aa61b8-8b07-49a2-92f5-3fad0601a675 req-420ba610-075b-4a32-98cf-6e1f72fbb260 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received event network-vif-plugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a4aa61b8-8b07-49a2-92f5-3fad0601a675 req-420ba610-075b-4a32-98cf-6e1f72fbb260 service nova] Acquiring lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a4aa61b8-8b07-49a2-92f5-3fad0601a675 req-420ba610-075b-4a32-98cf-6e1f72fbb260 service nova] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a4aa61b8-8b07-49a2-92f5-3fad0601a675 req-420ba610-075b-4a32-98cf-6e1f72fbb260 service nova] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-a4aa61b8-8b07-49a2-92f5-3fad0601a675 req-420ba610-075b-4a32-98cf-6e1f72fbb260 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] No waiting events found dispatching network-vif-plugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:07 user nova-compute[72000]: WARNING nova.compute.manager [req-a4aa61b8-8b07-49a2-92f5-3fad0601a675 req-420ba610-075b-4a32-98cf-6e1f72fbb260 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received unexpected event network-vif-plugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 for instance with vm_state building and task_state spawning.
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:07 user nova-compute[72000]: INFO nova.compute.manager [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:17:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:17:07 user nova-compute[72000]: INFO nova.compute.manager [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Took 7.12 seconds to build instance.
Aug 16 18:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8d786d-cc43-462d-ba67-909f09a6cc93 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.225s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Updating instance_info_cache with network_info: [{"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Releasing lock "refresh_cache-8cc7305c-fadd-4b61-8a34-1bfa31f3277c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Instance network_info: |[{"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-300efa4e-9d0e-4013-8822-ee6782a32c8b req-b63e8cd5-8793-4c5d-8f0f-f037436a03aa service nova] Acquired lock "refresh_cache-8cc7305c-fadd-4b61-8a34-1bfa31f3277c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.network.neutron [req-300efa4e-9d0e-4013-8822-ee6782a32c8b req-b63e8cd5-8793-4c5d-8f0f-f037436a03aa service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Refreshing network info cache for port 744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Start _get_guest_xml network_info=[{"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:17:07 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:17:07 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1775510123',display_name='tempest-VolumesSnapshotTestJSON-instance-1775510123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1775510123',id=32,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvu63Ty61yfq/DKbjoxZmfKC11lNj7WzeoedQfadvAwZUHqnnHcn9n5MShm9rSh+naPEz2KLaMGMvmT7vA6hBVIMApVbQXoZljwDWm1EgrIycGMqtjeP/WGF7vKWZ0Xfw==',key_name='tempest-keypair-1852876959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='502f251cf3c6455cb4f5beb33be18cce',ramdisk_id='',reservation_id='r-ieha3hef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2014651615',owner_user_name='tempest-VolumesSnapshotTestJSON-2014651615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e80d9a8665e34853897db6bd52e55b87',uuid=8cc7305c-fadd-4b61-8a34-1bfa31f3277c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converting VIF {"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=744d8e3a-4406-4ccf-b1df-fb38dc285f05,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744d8e3a-44') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.objects.instance [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cc7305c-fadd-4b61-8a34-1bfa31f3277c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:17:07 user nova-compute[72000]:   <uuid>8cc7305c-fadd-4b61-8a34-1bfa31f3277c</uuid>
Aug 16 18:17:07 user nova-compute[72000]:   <name>instance-00000020</name>
Aug 16 18:17:07 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:17:07 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:17:07 user nova-compute[72000]:   <metadata>
Aug 16 18:17:07 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:17:07 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:17:07 user nova-compute[72000]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1775510123</nova:name>
Aug 16 18:17:07 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:17:07</nova:creationTime>
Aug 16 18:17:07 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:17:07 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:17:07 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:17:07 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:17:07 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:17:07 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:17:07 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:17:07 user nova-compute[72000]:       <nova:owner>
Aug 16 18:17:07 user nova-compute[72000]:         <nova:user uuid="e80d9a8665e34853897db6bd52e55b87">tempest-VolumesSnapshotTestJSON-2014651615-project-member</nova:user>
Aug 16 18:17:07 user nova-compute[72000]:         <nova:project uuid="502f251cf3c6455cb4f5beb33be18cce">tempest-VolumesSnapshotTestJSON-2014651615</nova:project>
Aug 16 18:17:07 user nova-compute[72000]:       </nova:owner>
Aug 16 18:17:07 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:17:07 user nova-compute[72000]:       <nova:ports>
Aug 16 18:17:07 user nova-compute[72000]:         <nova:port uuid="744d8e3a-4406-4ccf-b1df-fb38dc285f05">
Aug 16 18:17:07 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 18:17:07 user nova-compute[72000]:         </nova:port>
Aug 16 18:17:07 user nova-compute[72000]:       </nova:ports>
Aug 16 18:17:07 user nova-compute[72000]:     </nova:instance>
Aug 16 18:17:07 user nova-compute[72000]:   </metadata>
Aug 16 18:17:07 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:17:07 user nova-compute[72000]:     <system>
Aug 16 18:17:07 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:17:07 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:17:07 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:17:07 user nova-compute[72000]:       <entry name="serial">8cc7305c-fadd-4b61-8a34-1bfa31f3277c</entry>
Aug 16 18:17:07 user nova-compute[72000]:       <entry name="uuid">8cc7305c-fadd-4b61-8a34-1bfa31f3277c</entry>
Aug 16 18:17:07 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:17:07 user nova-compute[72000]:     </system>
Aug 16 18:17:07 user nova-compute[72000]:   </sysinfo>
Aug 16 18:17:07 user nova-compute[72000]:   <os>
Aug 16 18:17:07 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:17:07 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:17:07 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:17:07 user nova-compute[72000]:   </os>
Aug 16 18:17:07 user nova-compute[72000]:   <features>
Aug 16 18:17:07 user nova-compute[72000]:     <acpi/>
Aug 16 18:17:07 user nova-compute[72000]:     <apic/>
Aug 16 18:17:07 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:17:07 user nova-compute[72000]:   </features>
Aug 16 18:17:07 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:17:07 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:17:07 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:17:07 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:17:07 user nova-compute[72000]:   </clock>
Aug 16 18:17:07 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:17:07 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:17:07 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:17:07 user nova-compute[72000]:   </cpu>
Aug 16 18:17:07 user nova-compute[72000]:   <devices>
Aug 16 18:17:07 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:17:07 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:17:07 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk"/>
Aug 16 18:17:07 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:17:07 user nova-compute[72000]:     </disk>
Aug 16 18:17:07 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:17:07 user nova-compute[72000]:       <mac address="fa:16:3e:ac:e4:bc"/>
Aug 16 18:17:07 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:17:07 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:17:07 user nova-compute[72000]:       <target dev="tap744d8e3a-44"/>
Aug 16 18:17:07 user nova-compute[72000]:     </interface>
Aug 16 18:17:07 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:17:07 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/console.log" append="off"/>
Aug 16 18:17:07 user nova-compute[72000]:     </serial>
Aug 16 18:17:07 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:17:07 user nova-compute[72000]:     <video>
Aug 16 18:17:07 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:17:07 user nova-compute[72000]:     </video>
Aug 16 18:17:07 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:17:07 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:17:07 user nova-compute[72000]:     </rng>
Aug 16 18:17:07 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:17:07 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:17:07 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:17:07 user nova-compute[72000]:     </memballoon>
Aug 16 18:17:07 user nova-compute[72000]:   </devices>
Aug 16 18:17:07 user nova-compute[72000]: </domain>
Aug 16 18:17:07 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1775510123',display_name='tempest-VolumesSnapshotTestJSON-instance-1775510123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1775510123',id=32,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvu63Ty61yfq/DKbjoxZmfKC11lNj7WzeoedQfadvAwZUHqnnHcn9n5MShm9rSh+naPEz2KLaMGMvmT7vA6hBVIMApVbQXoZljwDWm1EgrIycGMqtjeP/WGF7vKWZ0Xfw==',key_name='tempest-keypair-1852876959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='502f251cf3c6455cb4f5beb33be18cce',ramdisk_id='',reservation_id='r-ieha3hef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2014651615',owner_user_name='tempest-VolumesSnapshotTestJSON-2014651615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:17:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e80d9a8665e34853897db6bd52e55b87',uuid=8cc7305c-fadd-4b61-8a34-1bfa31f3277c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converting VIF {"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=744d8e3a-4406-4ccf-b1df-fb38dc285f05,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744d8e3a-44') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG os_vif [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=744d8e3a-4406-4ccf-b1df-fb38dc285f05,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744d8e3a-44') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap744d8e3a-44, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap744d8e3a-44, col_values=(('external_ids', {'iface-id': '744d8e3a-4406-4ccf-b1df-fb38dc285f05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:e4:bc', 'vm-uuid': '8cc7305c-fadd-4b61-8a34-1bfa31f3277c'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:07 user nova-compute[72000]: INFO os_vif [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=744d8e3a-4406-4ccf-b1df-fb38dc285f05,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744d8e3a-44')
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] No VIF found with MAC fa:16:3e:ac:e4:bc, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:17:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG nova.network.neutron [req-300efa4e-9d0e-4013-8822-ee6782a32c8b req-b63e8cd5-8793-4c5d-8f0f-f037436a03aa service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Updated VIF entry in instance network info cache for port 744d8e3a-4406-4ccf-b1df-fb38dc285f05. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG nova.network.neutron [req-300efa4e-9d0e-4013-8822-ee6782a32c8b req-b63e8cd5-8793-4c5d-8f0f-f037436a03aa service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Updating instance_info_cache with network_info: [{"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-300efa4e-9d0e-4013-8822-ee6782a32c8b req-b63e8cd5-8793-4c5d-8f0f-f037436a03aa service nova] Releasing lock "refresh_cache-8cc7305c-fadd-4b61-8a34-1bfa31f3277c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-403dee5a-7588-4a98-a966-835b72ace1a9 req-7eb5b09a-80ae-4d32-9dfa-7f1a646b71f7 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received event network-vif-plugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403dee5a-7588-4a98-a966-835b72ace1a9 req-7eb5b09a-80ae-4d32-9dfa-7f1a646b71f7 service nova] Acquiring lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403dee5a-7588-4a98-a966-835b72ace1a9 req-7eb5b09a-80ae-4d32-9dfa-7f1a646b71f7 service nova] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-403dee5a-7588-4a98-a966-835b72ace1a9 req-7eb5b09a-80ae-4d32-9dfa-7f1a646b71f7 service nova] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:09 user nova-compute[72000]: DEBUG nova.compute.manager [req-403dee5a-7588-4a98-a966-835b72ace1a9 req-7eb5b09a-80ae-4d32-9dfa-7f1a646b71f7 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] No waiting events found dispatching network-vif-plugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:09 user nova-compute[72000]: WARNING nova.compute.manager [req-403dee5a-7588-4a98-a966-835b72ace1a9 req-7eb5b09a-80ae-4d32-9dfa-7f1a646b71f7 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received unexpected event network-vif-plugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 for instance with vm_state building and task_state spawning.
Aug 16 18:17:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-1d2f5d56-7fc3-492e-a001-89e74ab3b9d5 req-277fc76a-7744-461f-8eeb-80f8971654ef service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received event network-changed-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-1d2f5d56-7fc3-492e-a001-89e74ab3b9d5 req-277fc76a-7744-461f-8eeb-80f8971654ef service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Refreshing instance network info cache due to event network-changed-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1d2f5d56-7fc3-492e-a001-89e74ab3b9d5 req-277fc76a-7744-461f-8eeb-80f8971654ef service nova] Acquiring lock "refresh_cache-ca0dfc09-f74e-4237-8759-a46b1842ee85" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1d2f5d56-7fc3-492e-a001-89e74ab3b9d5 req-277fc76a-7744-461f-8eeb-80f8971654ef service nova] Acquired lock "refresh_cache-ca0dfc09-f74e-4237-8759-a46b1842ee85" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG nova.network.neutron [req-1d2f5d56-7fc3-492e-a001-89e74ab3b9d5 req-277fc76a-7744-461f-8eeb-80f8971654ef service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Refreshing network info cache for port 6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG nova.network.neutron [req-1d2f5d56-7fc3-492e-a001-89e74ab3b9d5 req-277fc76a-7744-461f-8eeb-80f8971654ef service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Updated VIF entry in instance network info cache for port 6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG nova.network.neutron [req-1d2f5d56-7fc3-492e-a001-89e74ab3b9d5 req-277fc76a-7744-461f-8eeb-80f8971654ef service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Updating instance_info_cache with network_info: [{"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1d2f5d56-7fc3-492e-a001-89e74ab3b9d5 req-277fc76a-7744-461f-8eeb-80f8971654ef service nova] Releasing lock "refresh_cache-ca0dfc09-f74e-4237-8759-a46b1842ee85" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-7d96343c-1a09-4e94-8b50-5f491cb7f26d req-9a3460fe-16bc-403f-a4e3-f8ea810cc103 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received event network-vif-plugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7d96343c-1a09-4e94-8b50-5f491cb7f26d req-9a3460fe-16bc-403f-a4e3-f8ea810cc103 service nova] Acquiring lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7d96343c-1a09-4e94-8b50-5f491cb7f26d req-9a3460fe-16bc-403f-a4e3-f8ea810cc103 service nova] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7d96343c-1a09-4e94-8b50-5f491cb7f26d req-9a3460fe-16bc-403f-a4e3-f8ea810cc103 service nova] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-7d96343c-1a09-4e94-8b50-5f491cb7f26d req-9a3460fe-16bc-403f-a4e3-f8ea810cc103 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] No waiting events found dispatching network-vif-plugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:11 user nova-compute[72000]: WARNING nova.compute.manager [req-7d96343c-1a09-4e94-8b50-5f491cb7f26d req-9a3460fe-16bc-403f-a4e3-f8ea810cc103 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received unexpected event network-vif-plugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 for instance with vm_state building and task_state spawning.
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209832.1912951, 8cc7305c-fadd-4b61-8a34-1bfa31f3277c => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] VM Resumed (Lifecycle Event)
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:17:12 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Instance spawned successfully.
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209832.1943586, 8cc7305c-fadd-4b61-8a34-1bfa31f3277c => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] VM Started (Lifecycle Event)
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Took 6.66 seconds to spawn the instance on the hypervisor.
Aug 16 18:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Took 7.47 seconds to build instance.
Aug 16 18:17:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9d511310-a9ca-42ba-9b1b-94798c1bac31 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.568s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:13 user nova-compute[72000]: INFO nova.compute.manager [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Detaching volume d19dc181-5320-4040-8d40-c87b49b754d0
Aug 16 18:17:14 user nova-compute[72000]: INFO nova.virt.block_device [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Attempting to driver detach volume d19dc181-5320-4040-8d40-c87b49b754d0 from mountpoint /dev/vdb
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Attempting to detach device vdb from instance 04c75ec7-92c4-4130-8846-e867dd5384c4 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:17:14 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:17:14 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:17:14 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:17:14 user nova-compute[72000]:   <serial>d19dc181-5320-4040-8d40-c87b49b754d0</serial>
Aug 16 18:17:14 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:17:14 user nova-compute[72000]: </disk>
Aug 16 18:17:14 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:17:14 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Successfully detached device vdb from instance 04c75ec7-92c4-4130-8846-e867dd5384c4 from the persistent domain config.
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 04c75ec7-92c4-4130-8846-e867dd5384c4 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:17:14 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:17:14 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:17:14 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:17:14 user nova-compute[72000]:   <serial>d19dc181-5320-4040-8d40-c87b49b754d0</serial>
Aug 16 18:17:14 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:17:14 user nova-compute[72000]: </disk>
Aug 16 18:17:14 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:14 user nova-compute[72000]: INFO nova.compute.manager [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Detaching volume d404e6a3-3dc4-41ac-b92d-4cbffca77a1b
Aug 16 18:17:14 user nova-compute[72000]: INFO nova.virt.block_device [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Attempting to driver detach volume d404e6a3-3dc4-41ac-b92d-4cbffca77a1b from mountpoint /dev/vdb
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Attempting to detach device vdb from instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:17:14 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:17:14 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:17:14 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:17:14 user nova-compute[72000]:   <serial>d404e6a3-3dc4-41ac-b92d-4cbffca77a1b</serial>
Aug 16 18:17:14 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:17:14 user nova-compute[72000]: </disk>
Aug 16 18:17:14 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:17:14 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Successfully detached device vdb from instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a from the persistent domain config.
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:17:14 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:17:14 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:17:14 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:17:14 user nova-compute[72000]:   <serial>d404e6a3-3dc4-41ac-b92d-4cbffca77a1b</serial>
Aug 16 18:17:14 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:17:14 user nova-compute[72000]: </disk>
Aug 16 18:17:14 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209834.5922458, 04c75ec7-92c4-4130-8846-e867dd5384c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:17:14 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Successfully detached device vdb from instance 04c75ec7-92c4-4130-8846-e867dd5384c4 from the live domain config.
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GcvtzIsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:17:14 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.041s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d39f1f1-657d-4c90-8cb6-bc07d91e7e52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed2c27-320d-47b1-ad93-df3984857298]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:17:14 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:17:14 user nova-compute[72000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)
Aug 16 18:17:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:17:14 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:17:14 user nova-compute[72000]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 (non-flash)
Aug 16 18:17:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd010154f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0'): ({'sdd'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Removing single pathed devices sdd {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18cd861-13cb-44e3-9c8a-5ca4a4f6a557]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2a7c56-d3bd-4e0b-bc5f-8e3fa655be3f]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Flushing IO for device /dev/sdd {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[77050b19-e257-4245-b118-d0d104fab0db]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbf021f-65f5-4ee6-a55b-99c9edcfabcd]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7328276-35da-4534-97d8-2dd47e4ea4f5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209834.9641805, 59b456c9-e5af-4e47-a2f1-ba4f35c8308a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:17:14 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Successfully detached device vdb from instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a from the live domain config.
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7dc8a7-8559-4b0c-a419-14fed6377efa]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0, portal: 172.16.0.220,3260]
Aug 16 18:17:14 user nova-compute[72000]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0, portal: 172.16.0.220,3260] successful.
Aug 16 18:17:14 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xslSweYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:17:14 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:17:14 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d19dc181-5320-4040-8d40-c87b49b754d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df8edd1-864a-4566-ba22-92030aecde60]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] <== disconnect_volume: return (386ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.028s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[491e1037-f128-4cf4-afe7-20944eaafbf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9990124c-e0c8-45fb-a516-2fccaf4f2312]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:17:15 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:17:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b (non-flash)
Aug 16 18:17:15 user nova-compute[72000]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:17:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0100ee8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[852aeebd-c0cf-49a0-9a08-04586ee88bfb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[761677bf-d7a4-4afe-9c4b-feb71dadd6e7]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af8dc96-855a-4445-ab58-52d698e9a0a4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f043d6c-6ee3-4157-b174-4894ab45210b]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e7e3a6-cfdf-4fba-b32d-db7363055232]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c60b23-8018-4008-880e-acea87a665b0]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b, portal: 172.16.0.220,3260]
Aug 16 18:17:15 user nova-compute[72000]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b, portal: 172.16.0.220,3260] successful.
Aug 16 18:17:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e6a3-3dc4-41ac-b92d-4cbffca77a1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aab5a8-bbae-4e45-b109-45c8d03eabef]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] <== disconnect_volume: return (397ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'flavor' on Instance uuid ca0dfc09-f74e-4237-8759-a46b1842ee85 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:15 user nova-compute[72000]: INFO nova.compute.manager [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Attaching volume deae8b39-2e79-4abd-83d9-5c6135a64a35 to /dev/vdb
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.utils [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeabeaf-efc7-4c29-bba9-c26cb021b80b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f2a76f-8d4c-4ab1-a7d9-4b3d572d35df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[687c103c-9a25-4641-b3c0-3d31c3f742a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e866e136-560c-46e3-9f18-8dbea206b274]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG nova.objects.instance [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lazy-loading 'flavor' on Instance uuid 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:17:15 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:17:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[da98f412-216e-4084-92d4-913cab452bea]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG os_brick.utils [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:17:15 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Updating existing volume attachment record: 42a5cc04-d85a-41b2-b3c5-a9cf86767265 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:17:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b490bd88-5926-47b6-bfb5-e5d1242ed992 tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.042s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:16 user nova-compute[72000]: DEBUG nova.objects.instance [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'flavor' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-cdd90dd2-cbdd-494c-a6b5-c2999e9cb648 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.157s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:17:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:17:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:17:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:17:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:17:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:23 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updating instance_info_cache with network_info: [{"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-59b456c9-e5af-4e47-a2f1-ba4f35c8308a" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:17:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:17:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:17:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:17:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:17:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZkJtwDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:17:26 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:17:26 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:17:26 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3452543e-2f8c-406e-a6b6-eb2dc1a6b384]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:17:26 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4c92f6-dc16-4ae7-ad72-46a470b786fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35] added
Aug 16 18:17:26 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[292ab252-b8f4-4db6-bc13-18c1d81f63a3]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd756b1-3d91-4920-a066-1ad73488d271]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZkJtwDO {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZkJtwDO" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e62d06-305d-4a01-9728-74555b6785d5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uZkJtwDO'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0627785a-6e72-4012-b773-33401642143f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e109d6a-9f4e-46fe-afbd-44b739503d53]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:17:26 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:17:26 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --login" returned: 0 in 0.142s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc85986-e39e-4157-b4e9-51d2f1c43963]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35, portal: 172.16.0.220,3260]
Aug 16 18:17:26 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35, portal: 172.16.0.220,3260] successful.
Aug 16 18:17:26 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d692dd4-9370-4ca0-bbfa-68d30b805b89]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7db17b-8366-48ce-b88b-65d2bcbca437]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:17:26 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:17:26 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:17:26 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:17:26 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45b6574-d31e-4548-abbc-5edc0f419292]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZkJtwDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23138346461363131', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138346461363131', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'flavor' on Instance uuid ca0dfc09-f74e-4237-8759-a46b1842ee85 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:17:27 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:17:27 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:17:27 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:17:27 user nova-compute[72000]:   <serial>deae8b39-2e79-4abd-83d9-5c6135a64a35</serial>
Aug 16 18:17:27 user nova-compute[72000]: </disk>
Aug 16 18:17:27 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No VIF found with MAC fa:16:3e:8d:f4:2c, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4a785796-e1e2-4373-81bd-efdc22360749 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.518s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "c04a21ec-f583-4e0a-af9a-e6173ab84467" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:31 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:17:31 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7354MB free_disk=23.412471771240234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 618b087f-3794-4508-bc46-a30f888525ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 04c75ec7-92c4-4130-8846-e867dd5384c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance ca0dfc09-f74e-4237-8759-a46b1842ee85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6951079b-d2ca-41c3-9f4e-7090d13cb090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 8cc7305c-fadd-4b61-8a34-1bfa31f3277c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c04a21ec-f583-4e0a-af9a-e6173ab84467 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.348s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:17:31 user nova-compute[72000]: INFO nova.compute.claims [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Claim successful on node user
Aug 16 18:17:32 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:17:32 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:17:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG nova.policy [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfe1063b05894bfeb8f08bc29602b2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b557a84c43a47db90c0eb7054a77446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:17:32 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Creating image(s)
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "/opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "/opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "/opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk 1073741824" returned: 0 in 0.055s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Successfully created port: bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Cannot resize image /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'migration_context' on Instance uuid c04a21ec-f583-4e0a-af9a-e6173ab84467 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Ensure instance console log exists: /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Successfully updated port: bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "refresh_cache-c04a21ec-f583-4e0a-af9a-e6173ab84467" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquired lock "refresh_cache-c04a21ec-f583-4e0a-af9a-e6173ab84467" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.compute.manager [req-fd63763f-82b1-45b6-87dd-78cb9b108722 req-7a03444b-e353-4610-8ad0-0bd764e97fa4 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received event network-changed-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.compute.manager [req-fd63763f-82b1-45b6-87dd-78cb9b108722 req-7a03444b-e353-4610-8ad0-0bd764e97fa4 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Refreshing instance network info cache due to event network-changed-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fd63763f-82b1-45b6-87dd-78cb9b108722 req-7a03444b-e353-4610-8ad0-0bd764e97fa4 service nova] Acquiring lock "refresh_cache-c04a21ec-f583-4e0a-af9a-e6173ab84467" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Updating instance_info_cache with network_info: [{"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:34 user nova-compute[72000]: INFO nova.compute.manager [None req-5f878c34-a43f-40af-a159-6d659ea586f1 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Unrescuing
Aug 16 18:17:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f878c34-a43f-40af-a159-6d659ea586f1 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f878c34-a43f-40af-a159-6d659ea586f1 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquired lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5f878c34-a43f-40af-a159-6d659ea586f1 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Releasing lock "refresh_cache-c04a21ec-f583-4e0a-af9a-e6173ab84467" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Instance network_info: |[{"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fd63763f-82b1-45b6-87dd-78cb9b108722 req-7a03444b-e353-4610-8ad0-0bd764e97fa4 service nova] Acquired lock "refresh_cache-c04a21ec-f583-4e0a-af9a-e6173ab84467" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-fd63763f-82b1-45b6-87dd-78cb9b108722 req-7a03444b-e353-4610-8ad0-0bd764e97fa4 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Refreshing network info cache for port bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Start _get_guest_xml network_info=[{"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:17:34 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:17:34 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1636153086',display_name='tempest-AttachVolumeNegativeTest-server-1636153086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1636153086',id=33,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUcbL5H/wouaQMVNB7KHPlkbCTx5bSQh+8qH3XCtHWz25XgO/P7oo39VELv62SAWPdZUmTdT4NS0KvxU9Bg8OyYaJKyDQptPRfQ4rMS691LXAZ59JjmsG5MIR+P1tGgPQ==',key_name='tempest-keypair-236269707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-kxc0rw0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=c04a21ec-f583-4e0a-af9a-e6173ab84467,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c7:b2,bridge_name='br-int',has_traffic_filtering=True,id=bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd5e3ec-b6') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'pci_devices' on Instance uuid c04a21ec-f583-4e0a-af9a-e6173ab84467 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:17:34 user nova-compute[72000]:   <uuid>c04a21ec-f583-4e0a-af9a-e6173ab84467</uuid>
Aug 16 18:17:34 user nova-compute[72000]:   <name>instance-00000021</name>
Aug 16 18:17:34 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:17:34 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:17:34 user nova-compute[72000]:   <metadata>
Aug 16 18:17:34 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:17:34 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:17:34 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1636153086</nova:name>
Aug 16 18:17:34 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:17:34</nova:creationTime>
Aug 16 18:17:34 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:17:34 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:17:34 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:17:34 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:17:34 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:17:34 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:17:34 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:17:34 user nova-compute[72000]:       <nova:owner>
Aug 16 18:17:34 user nova-compute[72000]:         <nova:user uuid="cfe1063b05894bfeb8f08bc29602b2fa">tempest-AttachVolumeNegativeTest-678349136-project-member</nova:user>
Aug 16 18:17:34 user nova-compute[72000]:         <nova:project uuid="9b557a84c43a47db90c0eb7054a77446">tempest-AttachVolumeNegativeTest-678349136</nova:project>
Aug 16 18:17:34 user nova-compute[72000]:       </nova:owner>
Aug 16 18:17:34 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:17:34 user nova-compute[72000]:       <nova:ports>
Aug 16 18:17:34 user nova-compute[72000]:         <nova:port uuid="bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d">
Aug 16 18:17:34 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 18:17:34 user nova-compute[72000]:         </nova:port>
Aug 16 18:17:34 user nova-compute[72000]:       </nova:ports>
Aug 16 18:17:34 user nova-compute[72000]:     </nova:instance>
Aug 16 18:17:34 user nova-compute[72000]:   </metadata>
Aug 16 18:17:34 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:17:34 user nova-compute[72000]:     <system>
Aug 16 18:17:34 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:17:34 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:17:34 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:17:34 user nova-compute[72000]:       <entry name="serial">c04a21ec-f583-4e0a-af9a-e6173ab84467</entry>
Aug 16 18:17:34 user nova-compute[72000]:       <entry name="uuid">c04a21ec-f583-4e0a-af9a-e6173ab84467</entry>
Aug 16 18:17:34 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:17:34 user nova-compute[72000]:     </system>
Aug 16 18:17:34 user nova-compute[72000]:   </sysinfo>
Aug 16 18:17:34 user nova-compute[72000]:   <os>
Aug 16 18:17:34 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:17:34 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:17:34 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:17:34 user nova-compute[72000]:   </os>
Aug 16 18:17:34 user nova-compute[72000]:   <features>
Aug 16 18:17:34 user nova-compute[72000]:     <acpi/>
Aug 16 18:17:34 user nova-compute[72000]:     <apic/>
Aug 16 18:17:34 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:17:34 user nova-compute[72000]:   </features>
Aug 16 18:17:34 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:17:34 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:17:34 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:17:34 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:17:34 user nova-compute[72000]:   </clock>
Aug 16 18:17:34 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:17:34 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:17:34 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:17:34 user nova-compute[72000]:   </cpu>
Aug 16 18:17:34 user nova-compute[72000]:   <devices>
Aug 16 18:17:34 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:17:34 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:17:34 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk"/>
Aug 16 18:17:34 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:17:34 user nova-compute[72000]:     </disk>
Aug 16 18:17:34 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:17:34 user nova-compute[72000]:       <mac address="fa:16:3e:a8:c7:b2"/>
Aug 16 18:17:34 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:17:34 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:17:34 user nova-compute[72000]:       <target dev="tapbfd5e3ec-b6"/>
Aug 16 18:17:34 user nova-compute[72000]:     </interface>
Aug 16 18:17:34 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:17:34 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/console.log" append="off"/>
Aug 16 18:17:34 user nova-compute[72000]:     </serial>
Aug 16 18:17:34 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:17:34 user nova-compute[72000]:     <video>
Aug 16 18:17:34 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:17:34 user nova-compute[72000]:     </video>
Aug 16 18:17:34 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:17:34 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:17:34 user nova-compute[72000]:     </rng>
Aug 16 18:17:34 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:17:34 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:17:34 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:17:34 user nova-compute[72000]:     </memballoon>
Aug 16 18:17:34 user nova-compute[72000]:   </devices>
Aug 16 18:17:34 user nova-compute[72000]: </domain>
Aug 16 18:17:34 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1636153086',display_name='tempest-AttachVolumeNegativeTest-server-1636153086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1636153086',id=33,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUcbL5H/wouaQMVNB7KHPlkbCTx5bSQh+8qH3XCtHWz25XgO/P7oo39VELv62SAWPdZUmTdT4NS0KvxU9Bg8OyYaJKyDQptPRfQ4rMS691LXAZ59JjmsG5MIR+P1tGgPQ==',key_name='tempest-keypair-236269707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-kxc0rw0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=c04a21ec-f583-4e0a-af9a-e6173ab84467,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c7:b2,bridge_name='br-int',has_traffic_filtering=True,id=bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd5e3ec-b6') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG os_vif [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c7:b2,bridge_name='br-int',has_traffic_filtering=True,id=bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd5e3ec-b6') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfd5e3ec-b6, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfd5e3ec-b6, col_values=(('external_ids', {'iface-id': 'bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:c7:b2', 'vm-uuid': 'c04a21ec-f583-4e0a-af9a-e6173ab84467'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:34 user nova-compute[72000]: INFO os_vif [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c7:b2,bridge_name='br-int',has_traffic_filtering=True,id=bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd5e3ec-b6')
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No VIF found with MAC fa:16:3e:a8:c7:b2, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5f878c34-a43f-40af-a159-6d659ea586f1 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updating instance_info_cache with network_info: [{"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-fd63763f-82b1-45b6-87dd-78cb9b108722 req-7a03444b-e353-4610-8ad0-0bd764e97fa4 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Updated VIF entry in instance network info cache for port bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-fd63763f-82b1-45b6-87dd-78cb9b108722 req-7a03444b-e353-4610-8ad0-0bd764e97fa4 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Updating instance_info_cache with network_info: [{"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f878c34-a43f-40af-a159-6d659ea586f1 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Releasing lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5f878c34-a43f-40af-a159-6d659ea586f1 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'flavor' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fd63763f-82b1-45b6-87dd-78cb9b108722 req-7a03444b-e353-4610-8ad0-0bd764e97fa4 service nova] Releasing lock "refresh_cache-c04a21ec-f583-4e0a-af9a-e6173ab84467" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:35 user nova-compute[72000]: WARNING nova.compute.manager [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:17:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:35 user nova-compute[72000]: WARNING nova.compute.manager [req-539beebb-fafd-4036-9ed0-63a95c921bf5 req-b32648e2-4f8d-457e-8294-81d7a2d9d697 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:17:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:35 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Instance destroyed successfully.
Aug 16 18:17:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-c1fb06b0-b50b-49b2-8b29-e191aa07d5d1 req-52bf26e9-5cb8-4cc2-8a45-f9dffb401d74 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received event network-vif-plugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c1fb06b0-b50b-49b2-8b29-e191aa07d5d1 req-52bf26e9-5cb8-4cc2-8a45-f9dffb401d74 service nova] Acquiring lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c1fb06b0-b50b-49b2-8b29-e191aa07d5d1 req-52bf26e9-5cb8-4cc2-8a45-f9dffb401d74 service nova] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c1fb06b0-b50b-49b2-8b29-e191aa07d5d1 req-52bf26e9-5cb8-4cc2-8a45-f9dffb401d74 service nova] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-c1fb06b0-b50b-49b2-8b29-e191aa07d5d1 req-52bf26e9-5cb8-4cc2-8a45-f9dffb401d74 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] No waiting events found dispatching network-vif-plugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:36 user nova-compute[72000]: WARNING nova.compute.manager [req-c1fb06b0-b50b-49b2-8b29-e191aa07d5d1 req-52bf26e9-5cb8-4cc2-8a45-f9dffb401d74 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received unexpected event network-vif-plugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d for instance with vm_state building and task_state spawning.
Aug 16 18:17:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-7f9fe2fe-a153-460a-9679-35151d767659 req-b9a91281-b0bb-4652-b036-cd0031c531a5 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7f9fe2fe-a153-460a-9679-35151d767659 req-b9a91281-b0bb-4652-b036-cd0031c531a5 service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7f9fe2fe-a153-460a-9679-35151d767659 req-b9a91281-b0bb-4652-b036-cd0031c531a5 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7f9fe2fe-a153-460a-9679-35151d767659 req-b9a91281-b0bb-4652-b036-cd0031c531a5 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-7f9fe2fe-a153-460a-9679-35151d767659 req-b9a91281-b0bb-4652-b036-cd0031c531a5 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:37 user nova-compute[72000]: WARNING nova.compute.manager [req-7f9fe2fe-a153-460a-9679-35151d767659 req-b9a91281-b0bb-4652-b036-cd0031c531a5 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:17:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-7100af69-e8cd-4f83-b64e-85efa7bee111 req-e9aa061c-32a0-4e3f-956e-c1ff506d63b4 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received event network-vif-plugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7100af69-e8cd-4f83-b64e-85efa7bee111 req-e9aa061c-32a0-4e3f-956e-c1ff506d63b4 service nova] Acquiring lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7100af69-e8cd-4f83-b64e-85efa7bee111 req-e9aa061c-32a0-4e3f-956e-c1ff506d63b4 service nova] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7100af69-e8cd-4f83-b64e-85efa7bee111 req-e9aa061c-32a0-4e3f-956e-c1ff506d63b4 service nova] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-7100af69-e8cd-4f83-b64e-85efa7bee111 req-e9aa061c-32a0-4e3f-956e-c1ff506d63b4 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] No waiting events found dispatching network-vif-plugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:38 user nova-compute[72000]: WARNING nova.compute.manager [req-7100af69-e8cd-4f83-b64e-85efa7bee111 req-e9aa061c-32a0-4e3f-956e-c1ff506d63b4 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received unexpected event network-vif-plugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d for instance with vm_state building and task_state spawning.
Aug 16 18:17:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209859.1258743, c04a21ec-f583-4e0a-af9a-e6173ab84467 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:17:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] VM Resumed (Lifecycle Event)
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:17:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Instance spawned successfully.
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:17:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209859.1272638, c04a21ec-f583-4e0a-af9a-e6173ab84467 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:17:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] VM Started (Lifecycle Event)
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:17:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:17:39 user nova-compute[72000]: INFO nova.compute.manager [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Took 6.85 seconds to spawn the instance on the hypervisor.
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:39 user nova-compute[72000]: INFO nova.compute.manager [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Took 7.96 seconds to build instance.
Aug 16 18:17:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5eee433f-6ff0-41e5-8dda-d2595b6c1284 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.057s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209859.663613, bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:17:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] VM Resumed (Lifecycle Event)
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5f878c34-a43f-40af-a159-6d659ea586f1 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:17:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209859.6645463, bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:17:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] VM Started (Lifecycle Event)
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:17:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:17:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-b313a6ca-f677-4588-b57e-3c4840bbd96a req-8f802c3f-8b5c-4717-af8e-87b943e6ca27 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b313a6ca-f677-4588-b57e-3c4840bbd96a req-8f802c3f-8b5c-4717-af8e-87b943e6ca27 service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b313a6ca-f677-4588-b57e-3c4840bbd96a req-8f802c3f-8b5c-4717-af8e-87b943e6ca27 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b313a6ca-f677-4588-b57e-3c4840bbd96a req-8f802c3f-8b5c-4717-af8e-87b943e6ca27 service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-b313a6ca-f677-4588-b57e-3c4840bbd96a req-8f802c3f-8b5c-4717-af8e-87b943e6ca27 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:40 user nova-compute[72000]: WARNING nova.compute.manager [req-b313a6ca-f677-4588-b57e-3c4840bbd96a req-8f802c3f-8b5c-4717-af8e-87b943e6ca27 service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state active and task_state None.
Aug 16 18:17:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:50 user nova-compute[72000]: INFO nova.compute.manager [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Unshelving
Aug 16 18:17:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:50 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'pci_requests' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:50 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'numa_topology' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:17:50 user nova-compute[72000]: INFO nova.compute.claims [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Claim successful on node user
Aug 16 18:17:51 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:17:51 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:17:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:51 user nova-compute[72000]: INFO nova.network.neutron [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updating port 8a0ca71d-a462-47fa-85e8-6c689315db09 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 16 18:17:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquired lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-1dcde22c-62db-4615-af0f-8420223df30e req-0f6d67c2-b449-49a4-ad67-208283e52b54 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-changed-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-1dcde22c-62db-4615-af0f-8420223df30e req-0f6d67c2-b449-49a4-ad67-208283e52b54 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Refreshing instance network info cache due to event network-changed-8a0ca71d-a462-47fa-85e8-6c689315db09. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1dcde22c-62db-4615-af0f-8420223df30e req-0f6d67c2-b449-49a4-ad67-208283e52b54 service nova] Acquiring lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG nova.network.neutron [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updating instance_info_cache with network_info: [{"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Releasing lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:17:52 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Creating image(s)
Aug 16 18:17:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "/opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "/opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "/opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'trusted_certs' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1dcde22c-62db-4615-af0f-8420223df30e req-0f6d67c2-b449-49a4-ad67-208283e52b54 service nova] Acquired lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-1dcde22c-62db-4615-af0f-8420223df30e req-0f6d67c2-b449-49a4-ad67-208283e52b54 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Refreshing network info cache for port 8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "4265d71a0c59697f6943d461bb921bfff9dc8661" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "4265d71a0c59697f6943d461bb921bfff9dc8661" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661.part --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661.part --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:53 user nova-compute[72000]: DEBUG nova.virt.images [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] a78c4226-f222-46d8-a644-bb3e1132f60f was qcow2, converting to raw {{(pid=72000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 18:17:53 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:17:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661.part /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661.converted {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:53 user nova-compute[72000]: DEBUG nova.network.neutron [req-1dcde22c-62db-4615-af0f-8420223df30e req-0f6d67c2-b449-49a4-ad67-208283e52b54 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updated VIF entry in instance network info cache for port 8a0ca71d-a462-47fa-85e8-6c689315db09. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:17:53 user nova-compute[72000]: DEBUG nova.network.neutron [req-1dcde22c-62db-4615-af0f-8420223df30e req-0f6d67c2-b449-49a4-ad67-208283e52b54 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updating instance_info_cache with network_info: [{"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:17:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661.part /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661.converted" returned: 0 in 0.238s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661.converted --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1dcde22c-62db-4615-af0f-8420223df30e req-0f6d67c2-b449-49a4-ad67-208283e52b54 service nova] Releasing lock "refresh_cache-98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "4265d71a0c59697f6943d461bb921bfff9dc8661" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.632s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661 --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "4265d71a0c59697f6943d461bb921bfff9dc8661" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "4265d71a0c59697f6943d461bb921bfff9dc8661" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661 --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661,backing_fmt=raw /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661,backing_fmt=raw /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk 1073741824" returned: 0 in 0.050s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "4265d71a0c59697f6943d461bb921bfff9dc8661" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661 --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'migration_context' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Rebasing disk image.
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 -F raw /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 -F raw /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk" returned: 0 in 1.871s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Ensure instance console log exists: /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Start _get_guest_xml network_info=[{"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='367e453a8dd6150e870a252be29dd056',container_format='bare',created_at=2023-08-16T18:15:58Z,direct_url=<?>,disk_format='qcow2',id=a78c4226-f222-46d8-a644-bb3e1132f60f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-760819973-shelved',owner='c7b0883d8fa04d16ba310cd8ce6dbaa4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T18:16:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='367e453a8dd6150e870a252be29dd056',container_format='bare',created_at=2023-08-16T18:15:58Z,direct_url=<?>,disk_format='qcow2',id=a78c4226-f222-46d8-a644-bb3e1132f60f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-760819973-shelved',owner='c7b0883d8fa04d16ba310cd8ce6dbaa4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-16T18:16:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'vcpu_model' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760819973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760819973',id=28,image_ref='a78c4226-f222-46d8-a644-bb3e1132f60f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-562308264',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-jnf2nb8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member',shelved_at='2023-08-16T18:16:01.749056',shelved_host='user',shelved_image_id='a78c4226-f222-46d8-a644-bb3e1132f60f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:17:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'pci_devices' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:17:56 user nova-compute[72000]:   <uuid>98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34</uuid>
Aug 16 18:17:56 user nova-compute[72000]:   <name>instance-0000001c</name>
Aug 16 18:17:56 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:17:56 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:17:56 user nova-compute[72000]:   <metadata>
Aug 16 18:17:56 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:17:56 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:17:56 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-760819973</nova:name>
Aug 16 18:17:56 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:17:56</nova:creationTime>
Aug 16 18:17:56 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:17:56 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:17:56 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:17:56 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:17:56 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:17:56 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:17:56 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:17:56 user nova-compute[72000]:       <nova:owner>
Aug 16 18:17:56 user nova-compute[72000]:         <nova:user uuid="135d5cc19e204a448036340be3ad519a">tempest-AttachVolumeShelveTestJSON-1660838105-project-member</nova:user>
Aug 16 18:17:56 user nova-compute[72000]:         <nova:project uuid="c7b0883d8fa04d16ba310cd8ce6dbaa4">tempest-AttachVolumeShelveTestJSON-1660838105</nova:project>
Aug 16 18:17:56 user nova-compute[72000]:       </nova:owner>
Aug 16 18:17:56 user nova-compute[72000]:       <nova:root type="image" uuid="a78c4226-f222-46d8-a644-bb3e1132f60f"/>
Aug 16 18:17:56 user nova-compute[72000]:       <nova:ports>
Aug 16 18:17:56 user nova-compute[72000]:         <nova:port uuid="8a0ca71d-a462-47fa-85e8-6c689315db09">
Aug 16 18:17:56 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 18:17:56 user nova-compute[72000]:         </nova:port>
Aug 16 18:17:56 user nova-compute[72000]:       </nova:ports>
Aug 16 18:17:56 user nova-compute[72000]:     </nova:instance>
Aug 16 18:17:56 user nova-compute[72000]:   </metadata>
Aug 16 18:17:56 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:17:56 user nova-compute[72000]:     <system>
Aug 16 18:17:56 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:17:56 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:17:56 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:17:56 user nova-compute[72000]:       <entry name="serial">98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34</entry>
Aug 16 18:17:56 user nova-compute[72000]:       <entry name="uuid">98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34</entry>
Aug 16 18:17:56 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:17:56 user nova-compute[72000]:     </system>
Aug 16 18:17:56 user nova-compute[72000]:   </sysinfo>
Aug 16 18:17:56 user nova-compute[72000]:   <os>
Aug 16 18:17:56 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:17:56 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:17:56 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:17:56 user nova-compute[72000]:   </os>
Aug 16 18:17:56 user nova-compute[72000]:   <features>
Aug 16 18:17:56 user nova-compute[72000]:     <acpi/>
Aug 16 18:17:56 user nova-compute[72000]:     <apic/>
Aug 16 18:17:56 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:17:56 user nova-compute[72000]:   </features>
Aug 16 18:17:56 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:17:56 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:17:56 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:17:56 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:17:56 user nova-compute[72000]:   </clock>
Aug 16 18:17:56 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:17:56 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:17:56 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:17:56 user nova-compute[72000]:   </cpu>
Aug 16 18:17:56 user nova-compute[72000]:   <devices>
Aug 16 18:17:56 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:17:56 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:17:56 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk"/>
Aug 16 18:17:56 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:17:56 user nova-compute[72000]:     </disk>
Aug 16 18:17:56 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:17:56 user nova-compute[72000]:       <mac address="fa:16:3e:18:74:ba"/>
Aug 16 18:17:56 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:17:56 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:17:56 user nova-compute[72000]:       <target dev="tap8a0ca71d-a4"/>
Aug 16 18:17:56 user nova-compute[72000]:     </interface>
Aug 16 18:17:56 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:17:56 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/console.log" append="off"/>
Aug 16 18:17:56 user nova-compute[72000]:     </serial>
Aug 16 18:17:56 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:17:56 user nova-compute[72000]:     <video>
Aug 16 18:17:56 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:17:56 user nova-compute[72000]:     </video>
Aug 16 18:17:56 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:17:56 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:17:56 user nova-compute[72000]:     </rng>
Aug 16 18:17:56 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:17:56 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:17:56 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:17:56 user nova-compute[72000]:     </memballoon>
Aug 16 18:17:56 user nova-compute[72000]:   </devices>
Aug 16 18:17:56 user nova-compute[72000]: </domain>
Aug 16 18:17:56 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760819973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760819973',id=28,image_ref='a78c4226-f222-46d8-a644-bb3e1132f60f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-562308264',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-jnf2nb8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member',shelved_at='2023-08-16T18:16:01.749056',shelved_host='user',shelved_image_id='a78c4226-f222-46d8-a644-bb3e1132f60f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:17:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG os_vif [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a0ca71d-a4, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a0ca71d-a4, col_values=(('external_ids', {'iface-id': '8a0ca71d-a462-47fa-85e8-6c689315db09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:74:ba', 'vm-uuid': '98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:17:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:56 user nova-compute[72000]: INFO os_vif [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4')
Aug 16 18:17:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:17:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] No VIF found with MAC fa:16:3e:18:74:ba, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG nova.compute.manager [req-4b22370a-9c92-4a0c-b672-e0e6e60e773d req-995aaddf-2c53-4fc1-94fb-b8caed62dcb7 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4b22370a-9c92-4a0c-b672-e0e6e60e773d req-995aaddf-2c53-4fc1-94fb-b8caed62dcb7 service nova] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4b22370a-9c92-4a0c-b672-e0e6e60e773d req-995aaddf-2c53-4fc1-94fb-b8caed62dcb7 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4b22370a-9c92-4a0c-b672-e0e6e60e773d req-995aaddf-2c53-4fc1-94fb-b8caed62dcb7 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG nova.compute.manager [req-4b22370a-9c92-4a0c-b672-e0e6e60e773d req-995aaddf-2c53-4fc1-94fb-b8caed62dcb7 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] No waiting events found dispatching network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:17:58 user nova-compute[72000]: WARNING nova.compute.manager [req-4b22370a-9c92-4a0c-b672-e0e6e60e773d req-995aaddf-2c53-4fc1-94fb-b8caed62dcb7 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received unexpected event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 18:17:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:17:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209880.5685625, 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:18:00 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] VM Resumed (Lifecycle Event)
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:18:00 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance spawned successfully.
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:18:00 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692209880.5701458, 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:18:00 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] VM Started (Lifecycle Event)
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:18:00 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.compute.manager [req-a0aacb36-8507-4bae-9367-2b8c7f9a6bf0 req-c87e6d7b-cd04-4bd8-9b83-704f94a7c45b service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:18:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0aacb36-8507-4bae-9367-2b8c7f9a6bf0 req-c87e6d7b-cd04-4bd8-9b83-704f94a7c45b service nova] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0aacb36-8507-4bae-9367-2b8c7f9a6bf0 req-c87e6d7b-cd04-4bd8-9b83-704f94a7c45b service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0aacb36-8507-4bae-9367-2b8c7f9a6bf0 req-c87e6d7b-cd04-4bd8-9b83-704f94a7c45b service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.compute.manager [req-a0aacb36-8507-4bae-9367-2b8c7f9a6bf0 req-c87e6d7b-cd04-4bd8-9b83-704f94a7c45b service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] No waiting events found dispatching network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:18:00 user nova-compute[72000]: WARNING nova.compute.manager [req-a0aacb36-8507-4bae-9367-2b8c7f9a6bf0 req-c87e6d7b-cd04-4bd8-9b83-704f94a7c45b service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received unexpected event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 16 18:18:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:18:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26a76c79-e4ac-43dd-9ab2-bde4812a9430 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.303s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:04 user nova-compute[72000]: INFO nova.compute.manager [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Terminating instance
Aug 16 18:18:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-56968893-0178-40d6-87a0-9102c8a6eb0a req-c3710303-0664-48c4-8186-13d61a1c2f58 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received event network-vif-unplugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-56968893-0178-40d6-87a0-9102c8a6eb0a req-c3710303-0664-48c4-8186-13d61a1c2f58 service nova] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-56968893-0178-40d6-87a0-9102c8a6eb0a req-c3710303-0664-48c4-8186-13d61a1c2f58 service nova] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-56968893-0178-40d6-87a0-9102c8a6eb0a req-c3710303-0664-48c4-8186-13d61a1c2f58 service nova] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-56968893-0178-40d6-87a0-9102c8a6eb0a req-c3710303-0664-48c4-8186-13d61a1c2f58 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] No waiting events found dispatching network-vif-unplugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-56968893-0178-40d6-87a0-9102c8a6eb0a req-c3710303-0664-48c4-8186-13d61a1c2f58 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received event network-vif-unplugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.007s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:04 user nova-compute[72000]: INFO nova.compute.manager [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Terminating instance
Aug 16 18:18:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Instance destroyed successfully.
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lazy-loading 'resources' on Instance uuid 04c75ec7-92c4-4130-8846-e867dd5384c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:14:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1944849135',display_name='tempest-TestServerVolumeAttachmentScenario-server-1944849135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1944849135',id=29,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBGFAfIRAXUVCacVwex1FCtD7ZI5uv8FGqj9O2FlWTsOWVU7OLNxA8IuQXcNOkI9A+jzT5h1VEYPzN6FCg/zRBbiisG/u6dCyrzgPSoGUplyTn6xPaWpsv4Af1JoQJkCA==',key_name='tempest-keypair-1689008237',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07547c2b586949039549edd8518edd87',ramdisk_id='',reservation_id='r-qgdc7t7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1450812033',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1450812033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de8918c0e1224d8d8881df55de978103',uuid=04c75ec7-92c4-4130-8846-e867dd5384c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Converting VIF {"id": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "address": "fa:16:3e:14:4e:22", "network": {"id": "39774ec0-e19d-4867-ab51-0219e522b77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1506960463-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07547c2b586949039549edd8518edd87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e3b8c5-cd", "ovs_interfaceid": "83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:22,bridge_name='br-int',has_traffic_filtering=True,id=83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae,network=Network(39774ec0-e19d-4867-ab51-0219e522b77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e3b8c5-cd') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG os_vif [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:22,bridge_name='br-int',has_traffic_filtering=True,id=83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae,network=Network(39774ec0-e19d-4867-ab51-0219e522b77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e3b8c5-cd') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83e3b8c5-cd, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-0dbc8c95-fdbe-4f10-92e8-7f73f5524c6b req-4db360b1-e467-4f9e-990c-63c42581b884 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-unplugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0dbc8c95-fdbe-4f10-92e8-7f73f5524c6b req-4db360b1-e467-4f9e-990c-63c42581b884 service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0dbc8c95-fdbe-4f10-92e8-7f73f5524c6b req-4db360b1-e467-4f9e-990c-63c42581b884 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0dbc8c95-fdbe-4f10-92e8-7f73f5524c6b req-4db360b1-e467-4f9e-990c-63c42581b884 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-0dbc8c95-fdbe-4f10-92e8-7f73f5524c6b req-4db360b1-e467-4f9e-990c-63c42581b884 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-unplugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-0dbc8c95-fdbe-4f10-92e8-7f73f5524c6b req-4db360b1-e467-4f9e-990c-63c42581b884 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-unplugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:05 user nova-compute[72000]: INFO os_vif [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4e:22,bridge_name='br-int',has_traffic_filtering=True,id=83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae,network=Network(39774ec0-e19d-4867-ab51-0219e522b77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e3b8c5-cd')
Aug 16 18:18:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Deleting instance files /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4_del
Aug 16 18:18:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Deletion of /opt/stack/data/nova/instances/04c75ec7-92c4-4130-8846-e867dd5384c4_del complete
Aug 16 18:18:05 user nova-compute[72000]: INFO nova.compute.manager [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 18:18:05 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:18:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Instance destroyed successfully.
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lazy-loading 'resources' on Instance uuid 59b456c9-e5af-4e47-a2f1-ba4f35c8308a {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2089464051',display_name='tempest-ServerStableDeviceRescueTest-server-2089464051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2089464051',id=23,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmWHm+7UdTQBS4QPyRtaW5DeIq9vhtWvX9ADUJEe3SmS2eKqAGYy5hZmyostFsGOQwmHmbgjvWY/LQB29YraeQXctLkJ0iVxnUHBvmf5NJW5jt7hxy6Ex17BeVwofI2yQ==',key_name='tempest-keypair-414040881',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:14:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9e27c5995794fe5bf7567c740f2570d',ramdisk_id='',reservation_id='r-otkbq97w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1493393985',owner_user_name='tempest-ServerStableDeviceRescueTest-1493393985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:16:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d52e6531f15469cb663a6dda51b53fc',uuid=59b456c9-e5af-4e47-a2f1-ba4f35c8308a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Converting VIF {"id": "52283d99-7220-49dd-92cd-8489ee426bc1", "address": "fa:16:3e:02:5e:ea", "network": {"id": "16b11bd6-d226-449d-8035-04f4f3b3420a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1640489902-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9e27c5995794fe5bf7567c740f2570d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52283d99-72", "ovs_interfaceid": "52283d99-7220-49dd-92cd-8489ee426bc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:5e:ea,bridge_name='br-int',has_traffic_filtering=True,id=52283d99-7220-49dd-92cd-8489ee426bc1,network=Network(16b11bd6-d226-449d-8035-04f4f3b3420a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52283d99-72') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG os_vif [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:5e:ea,bridge_name='br-int',has_traffic_filtering=True,id=52283d99-7220-49dd-92cd-8489ee426bc1,network=Network(16b11bd6-d226-449d-8035-04f4f3b3420a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52283d99-72') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52283d99-72, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:18:05 user nova-compute[72000]: INFO os_vif [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:5e:ea,bridge_name='br-int',has_traffic_filtering=True,id=52283d99-7220-49dd-92cd-8489ee426bc1,network=Network(16b11bd6-d226-449d-8035-04f4f3b3420a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52283d99-72')
Aug 16 18:18:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Deleting instance files /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a_del
Aug 16 18:18:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Deletion of /opt/stack/data/nova/instances/59b456c9-e5af-4e47-a2f1-ba4f35c8308a_del complete
Aug 16 18:18:05 user nova-compute[72000]: INFO nova.compute.manager [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 18:18:05 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:18:05 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:18:06 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Took 0.92 seconds to deallocate network for instance.
Aug 16 18:18:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-1f08447a-a478-40bc-9c36-a81c7598db7f req-2d41545c-bdd2-4638-8f7e-705f01ee5921 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received event network-vif-deleted-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:18:06 user nova-compute[72000]: INFO nova.compute.manager [req-1f08447a-a478-40bc-9c36-a81c7598db7f req-2d41545c-bdd2-4638-8f7e-705f01ee5921 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Neutron deleted interface 83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae; detaching it from the instance and deleting it from the info cache
Aug 16 18:18:06 user nova-compute[72000]: DEBUG nova.network.neutron [req-1f08447a-a478-40bc-9c36-a81c7598db7f req-2d41545c-bdd2-4638-8f7e-705f01ee5921 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-1f08447a-a478-40bc-9c36-a81c7598db7f req-2d41545c-bdd2-4638-8f7e-705f01ee5921 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Detach interface failed, port_id=83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae, reason: Instance 04c75ec7-92c4-4130-8846-e867dd5384c4 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:06 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Deleted allocations for instance 04c75ec7-92c4-4130-8846-e867dd5384c4
Aug 16 18:18:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-17d864bb-1c63-4bfc-834a-df41dc7c08e9 req-30c71d63-d5ab-4d0c-aa20-cecafb24b2b2 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received event network-vif-plugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-17d864bb-1c63-4bfc-834a-df41dc7c08e9 req-30c71d63-d5ab-4d0c-aa20-cecafb24b2b2 service nova] Acquiring lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-17d864bb-1c63-4bfc-834a-df41dc7c08e9 req-30c71d63-d5ab-4d0c-aa20-cecafb24b2b2 service nova] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-17d864bb-1c63-4bfc-834a-df41dc7c08e9 req-30c71d63-d5ab-4d0c-aa20-cecafb24b2b2 service nova] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-17d864bb-1c63-4bfc-834a-df41dc7c08e9 req-30c71d63-d5ab-4d0c-aa20-cecafb24b2b2 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] No waiting events found dispatching network-vif-plugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:18:06 user nova-compute[72000]: WARNING nova.compute.manager [req-17d864bb-1c63-4bfc-834a-df41dc7c08e9 req-30c71d63-d5ab-4d0c-aa20-cecafb24b2b2 service nova] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Received unexpected event network-vif-plugged-83e3b8c5-cdb9-4f86-bd28-7d5c0f657aae for instance with vm_state deleted and task_state None.
Aug 16 18:18:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5a-753f-4aba-a126-21b5923e45ee tempest-TestServerVolumeAttachmentScenario-1450812033 tempest-TestServerVolumeAttachmentScenario-1450812033-project-member] Lock "04c75ec7-92c4-4130-8846-e867dd5384c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.481s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:07 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:18:07 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Took 1.33 seconds to deallocate network for instance.
Aug 16 18:18:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-46b21d09-14e1-4e30-9d23-818d4bae2208 req-fc23e0a9-1153-49f3-ab6d-7411cccd4669 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:18:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-46b21d09-14e1-4e30-9d23-818d4bae2208 req-fc23e0a9-1153-49f3-ab6d-7411cccd4669 service nova] Acquiring lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-46b21d09-14e1-4e30-9d23-818d4bae2208 req-fc23e0a9-1153-49f3-ab6d-7411cccd4669 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-46b21d09-14e1-4e30-9d23-818d4bae2208 req-fc23e0a9-1153-49f3-ab6d-7411cccd4669 service nova] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-46b21d09-14e1-4e30-9d23-818d4bae2208 req-fc23e0a9-1153-49f3-ab6d-7411cccd4669 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] No waiting events found dispatching network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:18:07 user nova-compute[72000]: WARNING nova.compute.manager [req-46b21d09-14e1-4e30-9d23-818d4bae2208 req-fc23e0a9-1153-49f3-ab6d-7411cccd4669 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received unexpected event network-vif-plugged-52283d99-7220-49dd-92cd-8489ee426bc1 for instance with vm_state deleted and task_state None.
Aug 16 18:18:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-46b21d09-14e1-4e30-9d23-818d4bae2208 req-fc23e0a9-1153-49f3-ab6d-7411cccd4669 service nova] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Received event network-vif-deleted-52283d99-7220-49dd-92cd-8489ee426bc1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:18:07 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:18:07 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:18:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:07 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Deleted allocations for instance 59b456c9-e5af-4e47-a2f1-ba4f35c8308a
Aug 16 18:18:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4e0aba1c-fa07-4d2c-b752-b4e3cb509037 tempest-ServerStableDeviceRescueTest-1493393985 tempest-ServerStableDeviceRescueTest-1493393985-project-member] Lock "59b456c9-e5af-4e47-a2f1-ba4f35c8308a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.747s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:18:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:18:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:18:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:18:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:20 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209885.1984382, 04c75ec7-92c4-4130-8846-e867dd5384c4 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:18:20 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] VM Stopped (Lifecycle Event)
Aug 16 18:18:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-27be2d70-d89e-46a3-8ad7-903aed0649e5 None None] [instance: 04c75ec7-92c4-4130-8846-e867dd5384c4] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:18:20 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209885.7355921, 59b456c9-e5af-4e47-a2f1-ba4f35c8308a => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:18:20 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] VM Stopped (Lifecycle Event)
Aug 16 18:18:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4c61b083-1909-4bc1-9465-5130fcb160b1 None None] [instance: 59b456c9-e5af-4e47-a2f1-ba4f35c8308a] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:18:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:18:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:18:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:18:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:18:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:18:24 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:18:25 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updating instance_info_cache with network_info: [{"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:18:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:18:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:18:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:18:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:18:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:18:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:18:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:18:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:18:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:18:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:18:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:18:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:18:32 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:18:32 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7268MB free_disk=23.488800048828125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 618b087f-3794-4508-bc46-a30f888525ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance ca0dfc09-f74e-4237-8759-a46b1842ee85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6951079b-d2ca-41c3-9f4e-7090d13cb090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 8cc7305c-fadd-4b61-8a34-1bfa31f3277c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c04a21ec-f583-4e0a-af9a-e6173ab84467 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:18:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:18:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:18:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:18:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:18:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:18:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:18:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:18:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-97c56cd8-4605-4e26-b594-c3bcfd397ed1 req-d8212a7c-bb0c-4656-b93b-058e20da7f4b service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received event network-changed-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:18:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-97c56cd8-4605-4e26-b594-c3bcfd397ed1 req-d8212a7c-bb0c-4656-b93b-058e20da7f4b service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Refreshing instance network info cache due to event network-changed-f4bc585f-bb94-4901-a32c-c1d1b0549ed1. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:18:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-97c56cd8-4605-4e26-b594-c3bcfd397ed1 req-d8212a7c-bb0c-4656-b93b-058e20da7f4b service nova] Acquiring lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:18:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-97c56cd8-4605-4e26-b594-c3bcfd397ed1 req-d8212a7c-bb0c-4656-b93b-058e20da7f4b service nova] Acquired lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:18:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-97c56cd8-4605-4e26-b594-c3bcfd397ed1 req-d8212a7c-bb0c-4656-b93b-058e20da7f4b service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Refreshing network info cache for port f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG nova.network.neutron [req-97c56cd8-4605-4e26-b594-c3bcfd397ed1 req-d8212a7c-bb0c-4656-b93b-058e20da7f4b service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Updated VIF entry in instance network info cache for port f4bc585f-bb94-4901-a32c-c1d1b0549ed1. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG nova.network.neutron [req-97c56cd8-4605-4e26-b594-c3bcfd397ed1 req-d8212a7c-bb0c-4656-b93b-058e20da7f4b service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Updating instance_info_cache with network_info: [{"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-97c56cd8-4605-4e26-b594-c3bcfd397ed1 req-d8212a7c-bb0c-4656-b93b-058e20da7f4b service nova] Releasing lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'flavor' on Instance uuid 6951079b-d2ca-41c3-9f4e-7090d13cb090 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:53 user nova-compute[72000]: INFO nova.compute.manager [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Attaching volume bb7bc70c-ac71-4de7-b65d-6f32eda0c666 to /dev/vdb
Aug 16 18:18:53 user nova-compute[72000]: DEBUG os_brick.utils [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f379916b-27f4-4ee6-9d55-9c74aeb265f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d478df4-0678-4960-8788-7b8a60ee2f18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.041s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[097b9fb5-51eb-470f-aad2-65b64763bd03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e26041-f77b-4781-b57d-a73a41852e9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:18:53 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:18:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d33663d-e864-49c2-bd9f-fe3fcd3b6bde]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG os_brick.utils [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Updating existing volume attachment record: 90802ced-0240-4628-bb09-47e491dcabc3 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:18:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:18:56 user nova-compute[72000]: DEBUG nova.compute.manager [req-918e621e-b958-4f38-b6b0-dd5a61b84c3b req-5d3fd90d-43c4-4ece-950f-823daf263f03 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received event network-changed-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:18:56 user nova-compute[72000]: DEBUG nova.compute.manager [req-918e621e-b958-4f38-b6b0-dd5a61b84c3b req-5d3fd90d-43c4-4ece-950f-823daf263f03 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Refreshing instance network info cache due to event network-changed-744d8e3a-4406-4ccf-b1df-fb38dc285f05. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:18:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-918e621e-b958-4f38-b6b0-dd5a61b84c3b req-5d3fd90d-43c4-4ece-950f-823daf263f03 service nova] Acquiring lock "refresh_cache-8cc7305c-fadd-4b61-8a34-1bfa31f3277c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:18:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-918e621e-b958-4f38-b6b0-dd5a61b84c3b req-5d3fd90d-43c4-4ece-950f-823daf263f03 service nova] Acquired lock "refresh_cache-8cc7305c-fadd-4b61-8a34-1bfa31f3277c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:18:56 user nova-compute[72000]: DEBUG nova.network.neutron [req-918e621e-b958-4f38-b6b0-dd5a61b84c3b req-5d3fd90d-43c4-4ece-950f-823daf263f03 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Refreshing network info cache for port 744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:18:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:56 user nova-compute[72000]: DEBUG nova.objects.instance [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'flavor' on Instance uuid 8cc7305c-fadd-4b61-8a34-1bfa31f3277c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:18:56 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Ignoring supplied device name: /dev/vdb
Aug 16 18:18:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:18:57 user nova-compute[72000]: INFO nova.compute.manager [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Attaching volume 9f2385ce-7177-4ca3-9e51-0fe62710bd74 to /dev/vdb
Aug 16 18:18:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-918e621e-b958-4f38-b6b0-dd5a61b84c3b req-5d3fd90d-43c4-4ece-950f-823daf263f03 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Updated VIF entry in instance network info cache for port 744d8e3a-4406-4ccf-b1df-fb38dc285f05. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-918e621e-b958-4f38-b6b0-dd5a61b84c3b req-5d3fd90d-43c4-4ece-950f-823daf263f03 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Updating instance_info_cache with network_info: [{"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-918e621e-b958-4f38-b6b0-dd5a61b84c3b req-5d3fd90d-43c4-4ece-950f-823daf263f03 service nova] Releasing lock "refresh_cache-8cc7305c-fadd-4b61-8a34-1bfa31f3277c" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG os_brick.utils [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c937082-8cce-40ed-b18e-766cbddd44a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[736a1f62-f294-4347-aa3d-84f3c319fd85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[82394eae-9f28-4b70-ab8b-0fd7ed055f59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7523645-a141-49fe-88de-a04e79071d98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:18:57 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:18:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5c8396-6da6-448e-8cd6-5f0027f56a52]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG os_brick.utils [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:18:57 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Updating existing volume attachment record: c9174938-cc12-40b4-bc01-473c56b96c6f {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:18:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXtBnbhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:19:08 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:19:08 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:19:08 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5701ec-47e1-438e-b777-fd4ff81da3e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:19:08 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6aa017-36d9-40ca-8376-18378698bc7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74] added
Aug 16 18:19:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a2a6d1-d39e-4ae4-88ab-948123588cef]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd0f32d-4835-4979-80d0-dbbb730a2a39]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXtBnbhL {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXtBnbhL" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26f1135-97b7-4e5d-a12b-a64560a6cb28]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXtBnbhL'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8163c9c-3175-499a-8c60-d94d4e180aca]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dc6c9f-90fb-48df-9388-d6b5cbc6ad0f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:08 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:08 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[de009d1a-b618-4675-8011-03d29d63fb60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74, portal: 172.16.0.220,3260]
Aug 16 18:19:08 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74, portal: 172.16.0.220,3260] successful.
Aug 16 18:19:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a75cde-c8c9-4676-83e0-994b054c97c6]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6251f2f3-9dfc-4d8b-8214-c675c88a9b7a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:08 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:08 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:08 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:08 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:08 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1507e8-7e52-4875-86ce-b9f816ae2a36]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:19:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:09 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:19:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXtBnbhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:19:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:19:09 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23962323164353964', 'path': '/dev/sdd'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:19:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962323164353964', 'path': '/dev/sdd'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:19:09 user nova-compute[72000]: DEBUG nova.objects.instance [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'flavor' on Instance uuid 8cc7305c-fadd-4b61-8a34-1bfa31f3277c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:19:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:19:09 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:19:09 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:19:09 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:19:09 user nova-compute[72000]:   <serial>9f2385ce-7177-4ca3-9e51-0fe62710bd74</serial>
Aug 16 18:19:09 user nova-compute[72000]: </disk>
Aug 16 18:19:09 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:19:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:19:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:19:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] No VIF found with MAC fa:16:3e:ac:e4:bc, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:19:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-9044acd0-1e4b-40b8-b581-e40b323811ef tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.259s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:19:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzJyxXve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:19:22 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:19:22 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:19:22 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0217b4bd-a447-44f2-9403-113fbfebe33d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:19:22 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8b89c2-e65d-4174-b456-01413d478152]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666] added
Aug 16 18:19:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa0e0cf-3035-4e05-8e3a-e07421d77b66]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb211ea-9e63-4be5-8d6e-5ecd155a4cf5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NzJyxXve {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NzJyxXve" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3642e176-240e-4ef4-8124-afcee8a350c6]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NzJyxXve'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed68679b-e17c-4b99-9ab5-d6e84be1ede7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f0f718-59b8-4047-81db-2455550e8a46]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe36d23-1049-4b06-ba1f-7adeaa0320b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666, portal: 172.16.0.220,3260]
Aug 16 18:19:22 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666, portal: 172.16.0.220,3260] successful.
Aug 16 18:19:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb9ebe7-dea5-413f-bf47-dd63042c33a9]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb430d5-7623-4662-88e2-12ba18aae972]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 (non-flash)
Aug 16 18:19:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-5abbf7b1-de2c-4709-987e-1472efa9560b req-3a36bbd7-8c9b-4998-ab02-3fb1c553e080 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received event network-changed-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-5abbf7b1-de2c-4709-987e-1472efa9560b req-3a36bbd7-8c9b-4998-ab02-3fb1c553e080 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Refreshing instance network info cache due to event network-changed-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5abbf7b1-de2c-4709-987e-1472efa9560b req-3a36bbd7-8c9b-4998-ab02-3fb1c553e080 service nova] Acquiring lock "refresh_cache-c04a21ec-f583-4e0a-af9a-e6173ab84467" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5abbf7b1-de2c-4709-987e-1472efa9560b req-3a36bbd7-8c9b-4998-ab02-3fb1c553e080 service nova] Acquired lock "refresh_cache-c04a21ec-f583-4e0a-af9a-e6173ab84467" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG nova.network.neutron [req-5abbf7b1-de2c-4709-987e-1472efa9560b req-3a36bbd7-8c9b-4998-ab02-3fb1c553e080 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Refreshing network info cache for port bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf9e112-d885-451d-8aa9-27903161c3f1]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzJyxXve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "c04a21ec-f583-4e0a-af9a-e6173ab84467" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:23 user nova-compute[72000]: INFO nova.compute.manager [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Terminating instance
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.network.neutron [req-5abbf7b1-de2c-4709-987e-1472efa9560b req-3a36bbd7-8c9b-4998-ab02-3fb1c553e080 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Updated VIF entry in instance network info cache for port bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.network.neutron [req-5abbf7b1-de2c-4709-987e-1472efa9560b req-3a36bbd7-8c9b-4998-ab02-3fb1c553e080 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Updating instance_info_cache with network_info: [{"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5abbf7b1-de2c-4709-987e-1472efa9560b req-3a36bbd7-8c9b-4998-ab02-3fb1c553e080 service nova] Releasing lock "refresh_cache-c04a21ec-f583-4e0a-af9a-e6173ab84467" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.compute.manager [req-b2ed2400-55c6-42a9-bfa4-284502da8ce9 req-d0061990-1ee7-4354-8d93-533029762975 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received event network-vif-unplugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b2ed2400-55c6-42a9-bfa4-284502da8ce9 req-d0061990-1ee7-4354-8d93-533029762975 service nova] Acquiring lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b2ed2400-55c6-42a9-bfa4-284502da8ce9 req-d0061990-1ee7-4354-8d93-533029762975 service nova] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b2ed2400-55c6-42a9-bfa4-284502da8ce9 req-d0061990-1ee7-4354-8d93-533029762975 service nova] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.compute.manager [req-b2ed2400-55c6-42a9-bfa4-284502da8ce9 req-d0061990-1ee7-4354-8d93-533029762975 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] No waiting events found dispatching network-vif-unplugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.compute.manager [req-b2ed2400-55c6-42a9-bfa4-284502da8ce9 req-d0061990-1ee7-4354-8d93-533029762975 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received event network-vif-unplugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23463356265363738', 'path': '/dev/sde'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463356265363738', 'path': '/dev/sde'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:19:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Instance destroyed successfully.
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'resources' on Instance uuid c04a21ec-f583-4e0a-af9a-e6173ab84467 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.objects.instance [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'flavor' on Instance uuid 6951079b-d2ca-41c3-9f4e-7090d13cb090 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1636153086',display_name='tempest-AttachVolumeNegativeTest-server-1636153086',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1636153086',id=33,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUcbL5H/wouaQMVNB7KHPlkbCTx5bSQh+8qH3XCtHWz25XgO/P7oo39VELv62SAWPdZUmTdT4NS0KvxU9Bg8OyYaJKyDQptPRfQ4rMS691LXAZ59JjmsG5MIR+P1tGgPQ==',key_name='tempest-keypair-236269707',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:17:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-kxc0rw0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=c04a21ec-f583-4e0a-af9a-e6173ab84467,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "address": "fa:16:3e:a8:c7:b2", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd5e3ec-b6", "ovs_interfaceid": "bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c7:b2,bridge_name='br-int',has_traffic_filtering=True,id=bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd5e3ec-b6') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG os_vif [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c7:b2,bridge_name='br-int',has_traffic_filtering=True,id=bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd5e3ec-b6') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfd5e3ec-b6, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:19:23 user nova-compute[72000]: INFO os_vif [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c7:b2,bridge_name='br-int',has_traffic_filtering=True,id=bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd5e3ec-b6')
Aug 16 18:19:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Deleting instance files /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467_del
Aug 16 18:19:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Deletion of /opt/stack/data/nova/instances/c04a21ec-f583-4e0a-af9a-e6173ab84467_del complete
Aug 16 18:19:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:19:23 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:19:23 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:19:23 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:19:23 user nova-compute[72000]:   <serial>bb7bc70c-ac71-4de7-b65d-6f32eda0c666</serial>
Aug 16 18:19:23 user nova-compute[72000]: </disk>
Aug 16 18:19:23 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:19:24 user nova-compute[72000]: INFO nova.compute.manager [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 16 18:19:24 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:19:24 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:19:24 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:19:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:19:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:19:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] No VIF found with MAC fa:16:3e:7f:f2:f6, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:19:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27e66a8b-5549-47a6-b6cc-c6be57f719cb tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:25 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:19:25 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Took 1.71 seconds to deallocate network for instance.
Aug 16 18:19:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-51bd642f-049b-4cb5-999d-228f9870c2d7 req-a5dff8cf-598b-4775-aab3-a9e1bd44731c service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received event network-vif-plugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-51bd642f-049b-4cb5-999d-228f9870c2d7 req-a5dff8cf-598b-4775-aab3-a9e1bd44731c service nova] Acquiring lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-51bd642f-049b-4cb5-999d-228f9870c2d7 req-a5dff8cf-598b-4775-aab3-a9e1bd44731c service nova] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-51bd642f-049b-4cb5-999d-228f9870c2d7 req-a5dff8cf-598b-4775-aab3-a9e1bd44731c service nova] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-51bd642f-049b-4cb5-999d-228f9870c2d7 req-a5dff8cf-598b-4775-aab3-a9e1bd44731c service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] No waiting events found dispatching network-vif-plugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:19:25 user nova-compute[72000]: WARNING nova.compute.manager [req-51bd642f-049b-4cb5-999d-228f9870c2d7 req-a5dff8cf-598b-4775-aab3-a9e1bd44731c service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received unexpected event network-vif-plugged-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d for instance with vm_state active and task_state deleting.
Aug 16 18:19:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-7ba68103-d3a5-4d4d-89fb-7ec5f436d56c req-9070c926-caa2-427e-a8ca-4d4e21fada42 service nova] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Received event network-vif-deleted-bfd5e3ec-b6d2-4dbf-b73a-ca5cd86deb9d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:26 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Deleted allocations for instance c04a21ec-f583-4e0a-af9a-e6173ab84467
Aug 16 18:19:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f06e49f2-0b62-4812-9fea-d47c8931eb01 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "c04a21ec-f583-4e0a-af9a-e6173ab84467" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.156s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.compute.manager [req-914efdcb-8f77-4e32-a9a5-24b9570dbd94 req-29ebce20-065b-474f-bb6c-237ec824cafe service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-changed-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.compute.manager [req-914efdcb-8f77-4e32-a9a5-24b9570dbd94 req-29ebce20-065b-474f-bb6c-237ec824cafe service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Refreshing instance network info cache due to event network-changed-675351e2-f9ae-41cd-a810-fb1d45a7186a. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-914efdcb-8f77-4e32-a9a5-24b9570dbd94 req-29ebce20-065b-474f-bb6c-237ec824cafe service nova] Acquiring lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-914efdcb-8f77-4e32-a9a5-24b9570dbd94 req-29ebce20-065b-474f-bb6c-237ec824cafe service nova] Acquired lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.network.neutron [req-914efdcb-8f77-4e32-a9a5-24b9570dbd94 req-29ebce20-065b-474f-bb6c-237ec824cafe service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Refreshing network info cache for port 675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:26 user nova-compute[72000]: INFO nova.compute.manager [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Detaching volume bb7bc70c-ac71-4de7-b65d-6f32eda0c666
Aug 16 18:19:26 user nova-compute[72000]: INFO nova.virt.block_device [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Attempting to driver detach volume bb7bc70c-ac71-4de7-b65d-6f32eda0c666 from mountpoint /dev/vdb
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Attempting to detach device vdb from instance 6951079b-d2ca-41c3-9f4e-7090d13cb090 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:19:26 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:19:26 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:19:26 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:19:26 user nova-compute[72000]:   <serial>bb7bc70c-ac71-4de7-b65d-6f32eda0c666</serial>
Aug 16 18:19:26 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:19:26 user nova-compute[72000]: </disk>
Aug 16 18:19:26 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:19:26 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Successfully detached device vdb from instance 6951079b-d2ca-41c3-9f4e-7090d13cb090 from the persistent domain config.
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6951079b-d2ca-41c3-9f4e-7090d13cb090 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:19:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:19:26 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:19:26 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:19:26 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:19:26 user nova-compute[72000]:   <serial>bb7bc70c-ac71-4de7-b65d-6f32eda0c666</serial>
Aug 16 18:19:26 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:19:26 user nova-compute[72000]: </disk>
Aug 16 18:19:26 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:27 user nova-compute[72000]: INFO nova.compute.manager [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Detaching volume e28ae0c1-16ae-463d-a1b1-6974b7adc5d5
Aug 16 18:19:27 user nova-compute[72000]: INFO nova.virt.block_device [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Attempting to driver detach volume e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 from mountpoint /dev/vdb
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Attempting to detach device vdb from instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:19:27 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:19:27 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:19:27 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:19:27 user nova-compute[72000]:   <serial>e28ae0c1-16ae-463d-a1b1-6974b7adc5d5</serial>
Aug 16 18:19:27 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:19:27 user nova-compute[72000]: </disk>
Aug 16 18:19:27 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:19:27 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Successfully detached device vdb from instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d from the persistent domain config.
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:19:27 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:19:27 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:19:27 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:19:27 user nova-compute[72000]:   <serial>e28ae0c1-16ae-463d-a1b1-6974b7adc5d5</serial>
Aug 16 18:19:27 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:19:27 user nova-compute[72000]: </disk>
Aug 16 18:19:27 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.network.neutron [req-914efdcb-8f77-4e32-a9a5-24b9570dbd94 req-29ebce20-065b-474f-bb6c-237ec824cafe service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updated VIF entry in instance network info cache for port 675351e2-f9ae-41cd-a810-fb1d45a7186a. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.network.neutron [req-914efdcb-8f77-4e32-a9a5-24b9570dbd94 req-29ebce20-065b-474f-bb6c-237ec824cafe service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updating instance_info_cache with network_info: [{"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Updating instance_info_cache with network_info: [{"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-914efdcb-8f77-4e32-a9a5-24b9570dbd94 req-29ebce20-065b-474f-bb6c-237ec824cafe service nova] Releasing lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209967.3960857, 6951079b-d2ca-41c3-9f4e-7090d13cb090 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6951079b-d2ca-41c3-9f4e-7090d13cb090 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:19:27 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Successfully detached device vdb from instance 6951079b-d2ca-41c3-9f4e-7090d13cb090 from the live domain config.
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzJyxXve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:19:27 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0f095b-159d-4100-a4f3-744846ef8c2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[898b7a07-99fe-404a-8e0e-694e8e840b7c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01c7c0e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666'): ({'sde'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Removing single pathed devices sde {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[10be34e7-b539-46a8-9c9e-5438273029a7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fa0d65-09f6-4667-9187-30640c84b49b]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Flushing IO for device /dev/sde {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1246059-bf18-46f0-a135-64bfc4395c35]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59be25ec-4752-4d60-be20-fb3f6cfce18d]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f347de3-8a60-4711-a391-dba6f773d070]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c3f09b-6710-412d-ae30-a9b098bd59ab]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666, portal: 172.16.0.220,3260]
Aug 16 18:19:27 user nova-compute[72000]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666, portal: 172.16.0.220,3260] successful.
Aug 16 18:19:27 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7bc70c-ac71-4de7-b65d-6f32eda0c666 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[707b3bac-7b9d-4b50-8942-7fa23234c79c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] <== disconnect_volume: return (321ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209967.7380185, bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:19:27 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Successfully detached device vdb from instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d from the live domain config.
Aug 16 18:19:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmrRbDgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:19:27 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc49d869-152c-47ba-b40f-ca8f666a6955]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a1204-da99-4b79-87e4-7a46db9367e4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:27 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01034b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bdb02a-e1ec-406b-92f6-6e9177cafcee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a7dfc-de37-4871-8971-c62c85caea0d]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c713fd-be84-41c1-8798-47e3d34f0242]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[af47c371-618f-4c0e-882a-534381d2d42e]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb02ed09-d776-4c33-a7f6-713b80b2a981]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b404b0f-ab21-4d26-b752-971450a796d2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5, portal: 172.16.0.220,3260]
Aug 16 18:19:28 user nova-compute[72000]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5, portal: 172.16.0.220,3260] successful.
Aug 16 18:19:28 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e28ae0c1-16ae-463d-a1b1-6974b7adc5d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e338933c-78d9-404a-b958-7b07ba33d9e9]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] <== disconnect_volume: return (299ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'flavor' on Instance uuid 6951079b-d2ca-41c3-9f4e-7090d13cb090 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3fc8637b-d151-4f3c-8ed2-b64cb3f6c946 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.832s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-ab17c564-57d8-434e-9692-1f14c4383f9e req-ce53214a-295c-40ea-9443-0f600e7fbe4b service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-changed-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-ab17c564-57d8-434e-9692-1f14c4383f9e req-ce53214a-295c-40ea-9443-0f600e7fbe4b service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Refreshing instance network info cache due to event network-changed-675351e2-f9ae-41cd-a810-fb1d45a7186a. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ab17c564-57d8-434e-9692-1f14c4383f9e req-ce53214a-295c-40ea-9443-0f600e7fbe4b service nova] Acquiring lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ab17c564-57d8-434e-9692-1f14c4383f9e req-ce53214a-295c-40ea-9443-0f600e7fbe4b service nova] Acquired lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG nova.network.neutron [req-ab17c564-57d8-434e-9692-1f14c4383f9e req-ce53214a-295c-40ea-9443-0f600e7fbe4b service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Refreshing network info cache for port 675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG nova.objects.instance [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'flavor' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1b2e1b31-5d52-4df1-bb67-c4baf4b0028a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.758s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-ab17c564-57d8-434e-9692-1f14c4383f9e req-ce53214a-295c-40ea-9443-0f600e7fbe4b service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updated VIF entry in instance network info cache for port 675351e2-f9ae-41cd-a810-fb1d45a7186a. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-ab17c564-57d8-434e-9692-1f14c4383f9e req-ce53214a-295c-40ea-9443-0f600e7fbe4b service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updating instance_info_cache with network_info: [{"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ab17c564-57d8-434e-9692-1f14c4383f9e req-ce53214a-295c-40ea-9443-0f600e7fbe4b service nova] Releasing lock "refresh_cache-bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:19:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:19:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:33 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:19:33 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=7581MB free_disk=23.513233184814453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 618b087f-3794-4508-bc46-a30f888525ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance ca0dfc09-f74e-4237-8759-a46b1842ee85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6951079b-d2ca-41c3-9f4e-7090d13cb090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 8cc7305c-fadd-4b61-8a34-1bfa31f3277c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:19:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:19:38 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209963.9344347, c04a21ec-f583-4e0a-af9a-e6173ab84467 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:19:38 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] VM Stopped (Lifecycle Event)
Aug 16 18:19:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3a325931-a2e8-41e8-acfd-03a8f8137c9e None None] [instance: c04a21ec-f583-4e0a-af9a-e6173ab84467] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:19:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:40 user nova-compute[72000]: INFO nova.compute.manager [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Terminating instance
Aug 16 18:19:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-13803af8-b049-41f3-b0c1-43fb2235f360 req-cae98169-5eb7-43e9-8a4a-934eb15c1ce7 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-vif-unplugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-13803af8-b049-41f3-b0c1-43fb2235f360 req-cae98169-5eb7-43e9-8a4a-934eb15c1ce7 service nova] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-13803af8-b049-41f3-b0c1-43fb2235f360 req-cae98169-5eb7-43e9-8a4a-934eb15c1ce7 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-13803af8-b049-41f3-b0c1-43fb2235f360 req-cae98169-5eb7-43e9-8a4a-934eb15c1ce7 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-13803af8-b049-41f3-b0c1-43fb2235f360 req-cae98169-5eb7-43e9-8a4a-934eb15c1ce7 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] No waiting events found dispatching network-vif-unplugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:19:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-13803af8-b049-41f3-b0c1-43fb2235f360 req-cae98169-5eb7-43e9-8a4a-934eb15c1ce7 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-vif-unplugged-8a0ca71d-a462-47fa-85e8-6c689315db09 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:19:41 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Instance destroyed successfully.
Aug 16 18:19:41 user nova-compute[72000]: DEBUG nova.objects.instance [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lazy-loading 'resources' on Instance uuid 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760819973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760819973',id=28,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL49CVt0Uq3olYK6lvp81M2OQr9EqGjZdkLgJJ/s+UcDWuE8BakkFDT59JWIXrQxn0Heygnh4BjsCmzFS1CDTkv9tenYbDAE3rcHIAIOvWaVWE7hH35uLXG71q+MS9xu2Q==',key_name='tempest-keypair-562308264',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7b0883d8fa04d16ba310cd8ce6dbaa4',ramdisk_id='',reservation_id='r-jnf2nb8c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1660838105',owner_user_name='tempest-AttachVolumeShelveTestJSON-1660838105-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='135d5cc19e204a448036340be3ad519a',uuid=98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converting VIF {"id": "8a0ca71d-a462-47fa-85e8-6c689315db09", "address": "fa:16:3e:18:74:ba", "network": {"id": "8e845422-4c0f-469d-a791-e7f51a54e360", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-816985831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7b0883d8fa04d16ba310cd8ce6dbaa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0ca71d-a4", "ovs_interfaceid": "8a0ca71d-a462-47fa-85e8-6c689315db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG os_vif [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a0ca71d-a4, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:41 user nova-compute[72000]: INFO os_vif [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:74:ba,bridge_name='br-int',has_traffic_filtering=True,id=8a0ca71d-a462-47fa-85e8-6c689315db09,network=Network(8e845422-4c0f-469d-a791-e7f51a54e360),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0ca71d-a4')
Aug 16 18:19:41 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Deleting instance files /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34_del
Aug 16 18:19:41 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Deletion of /opt/stack/data/nova/instances/98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34_del complete
Aug 16 18:19:41 user nova-compute[72000]: INFO nova.compute.manager [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 16 18:19:41 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:19:41 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:19:42 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Took 0.88 seconds to deallocate network for instance.
Aug 16 18:19:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-cdcfe014-ec1d-4b78-9d74-84b13fd99671 req-142a2f1c-4bac-4ff5-8475-06ac0f0ffc69 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-vif-deleted-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:42 user nova-compute[72000]: INFO nova.compute.manager [req-cdcfe014-ec1d-4b78-9d74-84b13fd99671 req-142a2f1c-4bac-4ff5-8475-06ac0f0ffc69 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Neutron deleted interface 8a0ca71d-a462-47fa-85e8-6c689315db09; detaching it from the instance and deleting it from the info cache
Aug 16 18:19:42 user nova-compute[72000]: DEBUG nova.network.neutron [req-cdcfe014-ec1d-4b78-9d74-84b13fd99671 req-142a2f1c-4bac-4ff5-8475-06ac0f0ffc69 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-cdcfe014-ec1d-4b78-9d74-84b13fd99671 req-142a2f1c-4bac-4ff5-8475-06ac0f0ffc69 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Detach interface failed, port_id=8a0ca71d-a462-47fa-85e8-6c689315db09, reason: Instance 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:42 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Deleted allocations for instance 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34
Aug 16 18:19:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-28c020a6-ab05-4916-bfc3-485dc72732c2 tempest-AttachVolumeShelveTestJSON-1660838105 tempest-AttachVolumeShelveTestJSON-1660838105-project-member] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.024s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-bbd6377f-3ea8-4991-b83f-25890411572b req-748884b2-7325-4d9f-b236-15d7f0af6604 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bbd6377f-3ea8-4991-b83f-25890411572b req-748884b2-7325-4d9f-b236-15d7f0af6604 service nova] Acquiring lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bbd6377f-3ea8-4991-b83f-25890411572b req-748884b2-7325-4d9f-b236-15d7f0af6604 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bbd6377f-3ea8-4991-b83f-25890411572b req-748884b2-7325-4d9f-b236-15d7f0af6604 service nova] Lock "98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-bbd6377f-3ea8-4991-b83f-25890411572b req-748884b2-7325-4d9f-b236-15d7f0af6604 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] No waiting events found dispatching network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:19:42 user nova-compute[72000]: WARNING nova.compute.manager [req-bbd6377f-3ea8-4991-b83f-25890411572b req-748884b2-7325-4d9f-b236-15d7f0af6604 service nova] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Received unexpected event network-vif-plugged-8a0ca71d-a462-47fa-85e8-6c689315db09 for instance with vm_state deleted and task_state None.
Aug 16 18:19:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:49 user nova-compute[72000]: INFO nova.compute.manager [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Detaching volume 9f2385ce-7177-4ca3-9e51-0fe62710bd74
Aug 16 18:19:49 user nova-compute[72000]: INFO nova.virt.block_device [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Attempting to driver detach volume 9f2385ce-7177-4ca3-9e51-0fe62710bd74 from mountpoint /dev/vdb
Aug 16 18:19:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Attempting to detach device vdb from instance 8cc7305c-fadd-4b61-8a34-1bfa31f3277c from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:19:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:19:49 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:19:49 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:19:49 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:19:49 user nova-compute[72000]:   <serial>9f2385ce-7177-4ca3-9e51-0fe62710bd74</serial>
Aug 16 18:19:49 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:19:49 user nova-compute[72000]: </disk>
Aug 16 18:19:49 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:19:49 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Successfully detached device vdb from instance 8cc7305c-fadd-4b61-8a34-1bfa31f3277c from the persistent domain config.
Aug 16 18:19:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8cc7305c-fadd-4b61-8a34-1bfa31f3277c from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:19:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:19:49 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:19:49 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:19:49 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:19:49 user nova-compute[72000]:   <serial>9f2385ce-7177-4ca3-9e51-0fe62710bd74</serial>
Aug 16 18:19:49 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:19:49 user nova-compute[72000]: </disk>
Aug 16 18:19:49 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:19:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692209990.5437834, 8cc7305c-fadd-4b61-8a34-1bfa31f3277c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8cc7305c-fadd-4b61-8a34-1bfa31f3277c {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:19:50 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Successfully detached device vdb from instance 8cc7305c-fadd-4b61-8a34-1bfa31f3277c from the live domain config.
Aug 16 18:19:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXtBnbhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:19:50 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[92df7a68-0154-44fa-9800-724285af958e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[326eff08-44b4-4aa4-838c-1907f42c83fd]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:50 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:50 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:50 user nova-compute[72000]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 (non-flash)
Aug 16 18:19:50 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01c7c23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74'): ({'sdd'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Removing single pathed devices sdd {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fc8e98-4b73-4fa9-8fab-3eab6e982187]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[afecd27c-4dc1-4eca-850b-7ba47f1bbd4c]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Flushing IO for device /dev/sdd {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e3b603-3a05-42c7-8e68-e88296d45ca4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[542c5a12-c21c-4774-a4e2-29b0042cf613]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7ec189-6ded-4fac-85a3-c77d82b91ea4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df9c15a-ac88-4470-a4a9-4a8aab7b3c35]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74, portal: 172.16.0.220,3260]
Aug 16 18:19:50 user nova-compute[72000]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74, portal: 172.16.0.220,3260] successful.
Aug 16 18:19:50 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbe214d-e7b6-45ea-a755-95103926afaf]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] <== disconnect_volume: return (297ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:19:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'flavor' on Instance uuid 8cc7305c-fadd-4b61-8a34-1bfa31f3277c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f94d35f8-3e75-487f-821e-23733dd7b857 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.772s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.658s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:51 user nova-compute[72000]: INFO nova.compute.manager [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Terminating instance
Aug 16 18:19:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-25a49246-c226-487d-bc09-ebc5233a9e94 req-84d5fde2-673b-4fe7-99ec-9ecc103d4966 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received event network-vif-unplugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-25a49246-c226-487d-bc09-ebc5233a9e94 req-84d5fde2-673b-4fe7-99ec-9ecc103d4966 service nova] Acquiring lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-25a49246-c226-487d-bc09-ebc5233a9e94 req-84d5fde2-673b-4fe7-99ec-9ecc103d4966 service nova] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-25a49246-c226-487d-bc09-ebc5233a9e94 req-84d5fde2-673b-4fe7-99ec-9ecc103d4966 service nova] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-25a49246-c226-487d-bc09-ebc5233a9e94 req-84d5fde2-673b-4fe7-99ec-9ecc103d4966 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] No waiting events found dispatching network-vif-unplugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:19:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-25a49246-c226-487d-bc09-ebc5233a9e94 req-84d5fde2-673b-4fe7-99ec-9ecc103d4966 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received event network-vif-unplugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:19:52 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Instance destroyed successfully.
Aug 16 18:19:52 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lazy-loading 'resources' on Instance uuid 8cc7305c-fadd-4b61-8a34-1bfa31f3277c {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1775510123',display_name='tempest-VolumesSnapshotTestJSON-instance-1775510123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1775510123',id=32,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvu63Ty61yfq/DKbjoxZmfKC11lNj7WzeoedQfadvAwZUHqnnHcn9n5MShm9rSh+naPEz2KLaMGMvmT7vA6hBVIMApVbQXoZljwDWm1EgrIycGMqtjeP/WGF7vKWZ0Xfw==',key_name='tempest-keypair-1852876959',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:17:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='502f251cf3c6455cb4f5beb33be18cce',ramdisk_id='',reservation_id='r-ieha3hef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2014651615',owner_user_name='tempest-VolumesSnapshotTestJSON-2014651615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e80d9a8665e34853897db6bd52e55b87',uuid=8cc7305c-fadd-4b61-8a34-1bfa31f3277c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converting VIF {"id": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "address": "fa:16:3e:ac:e4:bc", "network": {"id": "3317f168-9766-4692-9737-269bfe98d560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-568671512-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "502f251cf3c6455cb4f5beb33be18cce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744d8e3a-44", "ovs_interfaceid": "744d8e3a-4406-4ccf-b1df-fb38dc285f05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=744d8e3a-4406-4ccf-b1df-fb38dc285f05,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744d8e3a-44') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_vif [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=744d8e3a-4406-4ccf-b1df-fb38dc285f05,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744d8e3a-44') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap744d8e3a-44, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:19:52 user nova-compute[72000]: INFO os_vif [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:e4:bc,bridge_name='br-int',has_traffic_filtering=True,id=744d8e3a-4406-4ccf-b1df-fb38dc285f05,network=Network(3317f168-9766-4692-9737-269bfe98d560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744d8e3a-44')
Aug 16 18:19:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXtBnbhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:19:52 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2385ce-7177-4ca3-9e51-0fe62710bd74', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee76546-83f4-4756-884c-c7c8aba30878]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3881cba-5a69-418e-b23a-80b5cfc9b487]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:52 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:19:52 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0103297e0>, {}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Disconnecting from: [] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] <== disconnect_volume: return (47ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:19:52 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Deleting instance files /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c_del
Aug 16 18:19:52 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Deletion of /opt/stack/data/nova/instances/8cc7305c-fadd-4b61-8a34-1bfa31f3277c_del complete
Aug 16 18:19:52 user nova-compute[72000]: INFO nova.compute.manager [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 18:19:52 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:19:52 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-c2493701-93f5-452c-af8d-48c03c550871 req-4a0c9898-8eba-4766-bb37-7c9c9d757ac1 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received event network-vif-deleted-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:53 user nova-compute[72000]: INFO nova.compute.manager [req-c2493701-93f5-452c-af8d-48c03c550871 req-4a0c9898-8eba-4766-bb37-7c9c9d757ac1 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Neutron deleted interface 744d8e3a-4406-4ccf-b1df-fb38dc285f05; detaching it from the instance and deleting it from the info cache
Aug 16 18:19:53 user nova-compute[72000]: DEBUG nova.network.neutron [req-c2493701-93f5-452c-af8d-48c03c550871 req-4a0c9898-8eba-4766-bb37-7c9c9d757ac1 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:19:53 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Took 0.87 seconds to deallocate network for instance.
Aug 16 18:19:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-c2493701-93f5-452c-af8d-48c03c550871 req-4a0c9898-8eba-4766-bb37-7c9c9d757ac1 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Detach interface failed, port_id=744d8e3a-4406-4ccf-b1df-fb38dc285f05, reason: Instance 8cc7305c-fadd-4b61-8a34-1bfa31f3277c could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:19:53 user nova-compute[72000]: WARNING nova.volume.cinder [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Attachment c9174938-cc12-40b4-bc01-473c56b96c6f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c9174938-cc12-40b4-bc01-473c56b96c6f. (HTTP 404) (Request-ID: req-47dd29f0-c008-458f-a3f8-67c0f1f60dd7)
Aug 16 18:19:53 user nova-compute[72000]: INFO nova.compute.manager [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Took 0.03 seconds to detach 1 volumes for instance.
Aug 16 18:19:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:53 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Deleted allocations for instance 8cc7305c-fadd-4b61-8a34-1bfa31f3277c
Aug 16 18:19:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ce2b3652-34ce-4634-8abc-7fb69fb31fd5 tempest-VolumesSnapshotTestJSON-2014651615 tempest-VolumesSnapshotTestJSON-2014651615-project-member] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.267s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-a1e6691d-4fa5-44d8-b79a-e35058587210 req-ffd87831-d9ec-45c7-9fd6-458a5713a3a5 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received event network-vif-plugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a1e6691d-4fa5-44d8-b79a-e35058587210 req-ffd87831-d9ec-45c7-9fd6-458a5713a3a5 service nova] Acquiring lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a1e6691d-4fa5-44d8-b79a-e35058587210 req-ffd87831-d9ec-45c7-9fd6-458a5713a3a5 service nova] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a1e6691d-4fa5-44d8-b79a-e35058587210 req-ffd87831-d9ec-45c7-9fd6-458a5713a3a5 service nova] Lock "8cc7305c-fadd-4b61-8a34-1bfa31f3277c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:19:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-a1e6691d-4fa5-44d8-b79a-e35058587210 req-ffd87831-d9ec-45c7-9fd6-458a5713a3a5 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] No waiting events found dispatching network-vif-plugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:19:53 user nova-compute[72000]: WARNING nova.compute.manager [req-a1e6691d-4fa5-44d8-b79a-e35058587210 req-ffd87831-d9ec-45c7-9fd6-458a5713a3a5 service nova] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Received unexpected event network-vif-plugged-744d8e3a-4406-4ccf-b1df-fb38dc285f05 for instance with vm_state deleted and task_state None.
Aug 16 18:19:56 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209981.0099473, 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:19:56 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] VM Stopped (Lifecycle Event)
Aug 16 18:19:56 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b0b499e7-7d81-485f-ba4a-b0b1ca66dc0c None None] [instance: 98a43fa4-a3f1-4bb8-bd67-9b5ea07dca34] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:19:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:20:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:20:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:20:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:20:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:07 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692209992.4091332, 8cc7305c-fadd-4b61-8a34-1bfa31f3277c => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:20:07 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] VM Stopped (Lifecycle Event)
Aug 16 18:20:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-16abd7ad-e355-41d8-9e75-fbe3abe39884 None None] [instance: 8cc7305c-fadd-4b61-8a34-1bfa31f3277c] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:20:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:15 user nova-compute[72000]: INFO nova.compute.manager [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Detaching volume deae8b39-2e79-4abd-83d9-5c6135a64a35
Aug 16 18:20:15 user nova-compute[72000]: INFO nova.virt.block_device [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Attempting to driver detach volume deae8b39-2e79-4abd-83d9-5c6135a64a35 from mountpoint /dev/vdb
Aug 16 18:20:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Attempting to detach device vdb from instance ca0dfc09-f74e-4237-8759-a46b1842ee85 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:20:15 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:20:15 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:20:15 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:20:15 user nova-compute[72000]:   <serial>deae8b39-2e79-4abd-83d9-5c6135a64a35</serial>
Aug 16 18:20:15 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:20:15 user nova-compute[72000]: </disk>
Aug 16 18:20:15 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:20:15 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully detached device vdb from instance ca0dfc09-f74e-4237-8759-a46b1842ee85 from the persistent domain config.
Aug 16 18:20:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca0dfc09-f74e-4237-8759-a46b1842ee85 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:20:15 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:20:15 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:20:15 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:20:15 user nova-compute[72000]:   <serial>deae8b39-2e79-4abd-83d9-5c6135a64a35</serial>
Aug 16 18:20:15 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:20:15 user nova-compute[72000]: </disk>
Aug 16 18:20:15 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692210015.8112738, ca0dfc09-f74e-4237-8759-a46b1842ee85 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca0dfc09-f74e-4237-8759-a46b1842ee85 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:20:15 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully detached device vdb from instance ca0dfc09-f74e-4237-8759-a46b1842ee85 from the live domain config.
Aug 16 18:20:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZkJtwDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:20:15 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd43dac5-113b-467d-8f3a-849030e295b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8bf058-6825-4ca6-945f-25a9f54188ae]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:20:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 (non-flash)
Aug 16 18:20:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd00824d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d89bdf2-2d87-4ca9-83a3-6e10033702d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d8cea-3227-4d8b-a4bf-0ef350f05845]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9667a132-9c95-4047-9875-19441403c79a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6116174d-05ac-42b4-a4a9-f66e8d3e9daa]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:20:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14db662-949a-492f-8a2a-bdff4343c3e2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[390fa666-91d5-4b9e-bb33-d47a3827e994]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35, portal: 172.16.0.220,3260]
Aug 16 18:20:16 user nova-compute[72000]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35, portal: 172.16.0.220,3260] successful.
Aug 16 18:20:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deae8b39-2e79-4abd-83d9-5c6135a64a35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ef30c0-5c6d-4e9d-89b1-2c568b74375e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] <== disconnect_volume: return (256ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:20:16 user nova-compute[72000]: DEBUG nova.objects.instance [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'flavor' on Instance uuid ca0dfc09-f74e-4237-8759-a46b1842ee85 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-741c3bbe-454d-4dce-a74e-d70bed94500e tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.837s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:17 user nova-compute[72000]: INFO nova.compute.manager [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Terminating instance
Aug 16 18:20:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG nova.compute.manager [req-121ea09b-6d12-49ad-b317-39ebc50d8385 req-e8f8a7f7-de7f-4ee4-b35e-76c0a0149174 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received event network-changed-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG nova.compute.manager [req-121ea09b-6d12-49ad-b317-39ebc50d8385 req-e8f8a7f7-de7f-4ee4-b35e-76c0a0149174 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Refreshing instance network info cache due to event network-changed-f4bc585f-bb94-4901-a32c-c1d1b0549ed1. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-121ea09b-6d12-49ad-b317-39ebc50d8385 req-e8f8a7f7-de7f-4ee4-b35e-76c0a0149174 service nova] Acquiring lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-121ea09b-6d12-49ad-b317-39ebc50d8385 req-e8f8a7f7-de7f-4ee4-b35e-76c0a0149174 service nova] Acquired lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG nova.network.neutron [req-121ea09b-6d12-49ad-b317-39ebc50d8385 req-e8f8a7f7-de7f-4ee4-b35e-76c0a0149174 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Refreshing network info cache for port f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:17 user nova-compute[72000]: INFO nova.compute.manager [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Terminating instance
Aug 16 18:20:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:20:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fca3d7e0-0e5e-43ce-86ab-a9423bc70100 req-f7471807-c588-4dd2-9e6d-67aa0b1af9eb service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received event network-vif-unplugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fca3d7e0-0e5e-43ce-86ab-a9423bc70100 req-f7471807-c588-4dd2-9e6d-67aa0b1af9eb service nova] Acquiring lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fca3d7e0-0e5e-43ce-86ab-a9423bc70100 req-f7471807-c588-4dd2-9e6d-67aa0b1af9eb service nova] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fca3d7e0-0e5e-43ce-86ab-a9423bc70100 req-f7471807-c588-4dd2-9e6d-67aa0b1af9eb service nova] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fca3d7e0-0e5e-43ce-86ab-a9423bc70100 req-f7471807-c588-4dd2-9e6d-67aa0b1af9eb service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] No waiting events found dispatching network-vif-unplugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-fca3d7e0-0e5e-43ce-86ab-a9423bc70100 req-f7471807-c588-4dd2-9e6d-67aa0b1af9eb service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received event network-vif-unplugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.network.neutron [req-121ea09b-6d12-49ad-b317-39ebc50d8385 req-e8f8a7f7-de7f-4ee4-b35e-76c0a0149174 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Updated VIF entry in instance network info cache for port f4bc585f-bb94-4901-a32c-c1d1b0549ed1. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.network.neutron [req-121ea09b-6d12-49ad-b317-39ebc50d8385 req-e8f8a7f7-de7f-4ee4-b35e-76c0a0149174 service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Updating instance_info_cache with network_info: [{"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-121ea09b-6d12-49ad-b317-39ebc50d8385 req-e8f8a7f7-de7f-4ee4-b35e-76c0a0149174 service nova] Releasing lock "refresh_cache-6951079b-d2ca-41c3-9f4e-7090d13cb090" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Instance destroyed successfully.
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.objects.instance [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'resources' on Instance uuid bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1881362050',display_name='tempest-ServerRescueNegativeTestJSON-server-1881362050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1881362050',id=26,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOax8cUTQytSdtGTyC9MeCOoaVGwmHO7ZUgzG4i+NFpXjqfhVR25SFddxqnnAXGZgfzQbOc5+YYks+mN9ZsSDQcEAlypm3l3jev6N/AWDWshdH5tGXlV+Y3ZzhzTJGdBA==',key_name='tempest-keypair-1907527833',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:15:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-g5r9ilfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d07d329987884ac98b87374ca2074b86',uuid=bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "address": "fa:16:3e:c8:70:1c", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap675351e2-f9", "ovs_interfaceid": "675351e2-f9ae-41cd-a810-fb1d45a7186a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:70:1c,bridge_name='br-int',has_traffic_filtering=True,id=675351e2-f9ae-41cd-a810-fb1d45a7186a,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap675351e2-f9') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG os_vif [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:70:1c,bridge_name='br-int',has_traffic_filtering=True,id=675351e2-f9ae-41cd-a810-fb1d45a7186a,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap675351e2-f9') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap675351e2-f9, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: INFO os_vif [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:70:1c,bridge_name='br-int',has_traffic_filtering=True,id=675351e2-f9ae-41cd-a810-fb1d45a7186a,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap675351e2-f9')
Aug 16 18:20:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Deleting instance files /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d_del
Aug 16 18:20:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Deletion of /opt/stack/data/nova/instances/bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d_del complete
Aug 16 18:20:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Instance destroyed successfully.
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.objects.instance [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'resources' on Instance uuid 6951079b-d2ca-41c3-9f4e-7090d13cb090 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:16:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2139753412',display_name='tempest-TestStampPattern-server-2139753412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2139753412',id=31,image_ref='2ea78fd4-ae9f-46aa-928f-354f91b3acda',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnL9X6wz3GwRD3jGjdqTIwmD/7nKpA3bWQ1ZIEuWHKZC1VpFYkzRFXTP/yQJ9fYNYYuFbJpkSkCeUgHRnAHArKDMODurNq3Vj+iMZJqARRn9GQICSStCAl47V2JXBmY1g==',key_name='tempest-TestStampPattern-2099348715',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6fe73c2955b4eddbbfd84bd9806ba88',ramdisk_id='',reservation_id='r-j05al0gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='618b087f-3794-4508-bc46-a30f888525ec',image_min_disk='1',image_min_ram='0',image_owner_id='c6fe73c2955b4eddbbfd84bd9806ba88',image_owner_project_name='tempest-TestStampPattern-463262942',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-463262942-project-member',image_user_id='bce14217bd604140a4082ca9f6b862c0',owner_project_name='tempest-TestStampPattern-463262942',owner_user_name='tempest-TestStampPattern-463262942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:17:07Z,user_data=None,user_id='bce14217bd604140a4082ca9f6b862c0',uuid=6951079b-d2ca-41c3-9f4e-7090d13cb090,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converting VIF {"id": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "address": "fa:16:3e:7f:f2:f6", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4bc585f-bb", "ovs_interfaceid": "f4bc585f-bb94-4901-a32c-c1d1b0549ed1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:f2:f6,bridge_name='br-int',has_traffic_filtering=True,id=f4bc585f-bb94-4901-a32c-c1d1b0549ed1,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bc585f-bb') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG os_vif [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:f2:f6,bridge_name='br-int',has_traffic_filtering=True,id=f4bc585f-bb94-4901-a32c-c1d1b0549ed1,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bc585f-bb') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4bc585f-bb, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:20:18 user nova-compute[72000]: INFO os_vif [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:f2:f6,bridge_name='br-int',has_traffic_filtering=True,id=f4bc585f-bb94-4901-a32c-c1d1b0549ed1,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4bc585f-bb')
Aug 16 18:20:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Deleting instance files /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090_del
Aug 16 18:20:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Deletion of /opt/stack/data/nova/instances/6951079b-d2ca-41c3-9f4e-7090d13cb090_del complete
Aug 16 18:20:18 user nova-compute[72000]: INFO nova.compute.manager [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 16 18:20:18 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:20:18 user nova-compute[72000]: INFO nova.compute.manager [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 16 18:20:18 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:20:19 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Took 0.74 seconds to deallocate network for instance.
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:20:19 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Took 0.95 seconds to deallocate network for instance.
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:20:19 user nova-compute[72000]: WARNING nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state deleted and task_state None.
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:20:19 user nova-compute[72000]: WARNING nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state deleted and task_state None.
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:20:19 user nova-compute[72000]: WARNING nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state deleted and task_state None.
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:20:19 user nova-compute[72000]: WARNING nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state deleted and task_state None.
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:20:19 user nova-compute[72000]: WARNING nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-unplugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state deleted and task_state None.
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Acquiring lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] No waiting events found dispatching network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:20:19 user nova-compute[72000]: WARNING nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received unexpected event network-vif-plugged-675351e2-f9ae-41cd-a810-fb1d45a7186a for instance with vm_state deleted and task_state None.
Aug 16 18:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-1ae7134f-38f4-4d9b-93d5-a6fa991a9358 req-255e113d-41f9-4258-8672-118ac85e9fde service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received event network-vif-deleted-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.035s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:19 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Deleted allocations for instance bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d
Aug 16 18:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dda41acc-81cc-45fb-99b2-4e88f1703e1e tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.569s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:20 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:20:20 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:20 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Deleted allocations for instance 6951079b-d2ca-41c3-9f4e-7090d13cb090
Aug 16 18:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-392e1255-b65f-4d8d-90e8-02892266a258 tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.446s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-ab225733-7db8-481c-82f6-f7c9edca6a62 req-66eb39a2-09a6-4989-939e-bf3c1e74d21c service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received event network-vif-plugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ab225733-7db8-481c-82f6-f7c9edca6a62 req-66eb39a2-09a6-4989-939e-bf3c1e74d21c service nova] Acquiring lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ab225733-7db8-481c-82f6-f7c9edca6a62 req-66eb39a2-09a6-4989-939e-bf3c1e74d21c service nova] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ab225733-7db8-481c-82f6-f7c9edca6a62 req-66eb39a2-09a6-4989-939e-bf3c1e74d21c service nova] Lock "6951079b-d2ca-41c3-9f4e-7090d13cb090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-ab225733-7db8-481c-82f6-f7c9edca6a62 req-66eb39a2-09a6-4989-939e-bf3c1e74d21c service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] No waiting events found dispatching network-vif-plugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:20:20 user nova-compute[72000]: WARNING nova.compute.manager [req-ab225733-7db8-481c-82f6-f7c9edca6a62 req-66eb39a2-09a6-4989-939e-bf3c1e74d21c service nova] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Received unexpected event network-vif-plugged-f4bc585f-bb94-4901-a32c-c1d1b0549ed1 for instance with vm_state deleted and task_state None.
Aug 16 18:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-ab225733-7db8-481c-82f6-f7c9edca6a62 req-66eb39a2-09a6-4989-939e-bf3c1e74d21c service nova] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Received event network-vif-deleted-675351e2-f9ae-41cd-a810-fb1d45a7186a {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:20:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:20:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:20:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:20:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:20:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:20:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:20:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:20:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:20:26 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:20:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updating instance_info_cache with network_info: [{"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:20:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:20:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:20:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:20:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:20:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:20:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:20:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:20:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:20:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:20:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:20:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:20:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:20:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:20:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:20:33 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:20:33 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8153MB free_disk=23.572254180908203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 966d4480-7413-43bc-9b0f-6a522e88908b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 618b087f-3794-4508-bc46-a30f888525ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance ca0dfc09-f74e-4237-8759-a46b1842ee85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210018.6858258, bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:20:33 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] VM Stopped (Lifecycle Event)
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b187ecb4-e3a6-4923-b11d-ddae61349e86 None None] [instance: bd996e8c-dedf-4614-8e9f-8bfc6b57ba9d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210018.7265065, 6951079b-d2ca-41c3-9f4e-7090d13cb090 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:20:33 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] VM Stopped (Lifecycle Event)
Aug 16 18:20:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-111c0e23-6cbf-406e-9416-821632c4fcaa None None] [instance: 6951079b-d2ca-41c3-9f4e-7090d13cb090] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:20:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:20:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:20:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:20:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:20:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:20:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:20:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:20:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:20:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:20:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:20:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:20:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:20:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:05 user nova-compute[72000]: INFO nova.compute.manager [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Terminating instance
Aug 16 18:21:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-a7d193c7-01a6-470c-ab20-2fe3266655da req-e63c8b4c-1588-4ce8-9d5d-e8f5d981288f service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received event network-vif-unplugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a7d193c7-01a6-470c-ab20-2fe3266655da req-e63c8b4c-1588-4ce8-9d5d-e8f5d981288f service nova] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a7d193c7-01a6-470c-ab20-2fe3266655da req-e63c8b4c-1588-4ce8-9d5d-e8f5d981288f service nova] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a7d193c7-01a6-470c-ab20-2fe3266655da req-e63c8b4c-1588-4ce8-9d5d-e8f5d981288f service nova] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-a7d193c7-01a6-470c-ab20-2fe3266655da req-e63c8b4c-1588-4ce8-9d5d-e8f5d981288f service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] No waiting events found dispatching network-vif-unplugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:21:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-a7d193c7-01a6-470c-ab20-2fe3266655da req-e63c8b4c-1588-4ce8-9d5d-e8f5d981288f service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received event network-vif-unplugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:21:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Instance destroyed successfully.
Aug 16 18:21:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'resources' on Instance uuid ca0dfc09-f74e-4237-8759-a46b1842ee85 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:21:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1532322913',display_name='tempest-AttachVolumeNegativeTest-server-1532322913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1532322913',id=30,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmL3i4ASh8OCnviZVLXg0C96eS/a4ERtuPdcErYosbwBqbJ9AbQFci4edhfAlGtvHyN7pyLLnvxh+rdBOaggwgiVaji7zs0EphOOi0EnHU+9B4PaOgebGuLJm89gdRpGQ==',key_name='tempest-keypair-1792687114',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:15:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-gazm4wsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:15:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=ca0dfc09-f74e-4237-8759-a46b1842ee85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:21:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "address": "fa:16:3e:8d:f4:2c", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ef2ad33-df", "ovs_interfaceid": "6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:21:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:f4:2c,bridge_name='br-int',has_traffic_filtering=True,id=6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ef2ad33-df') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:21:06 user nova-compute[72000]: DEBUG os_vif [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:f4:2c,bridge_name='br-int',has_traffic_filtering=True,id=6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ef2ad33-df') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:21:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ef2ad33-df, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:21:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:21:06 user nova-compute[72000]: INFO os_vif [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:f4:2c,bridge_name='br-int',has_traffic_filtering=True,id=6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ef2ad33-df')
Aug 16 18:21:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Deleting instance files /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85_del
Aug 16 18:21:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Deletion of /opt/stack/data/nova/instances/ca0dfc09-f74e-4237-8759-a46b1842ee85_del complete
Aug 16 18:21:06 user nova-compute[72000]: INFO nova.compute.manager [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 18:21:06 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:21:06 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:21:06 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:21:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-ee659813-45fe-4e26-a729-af6c826f1c75 req-6194b208-cd54-4621-b727-46870c76848f service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received event network-vif-plugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ee659813-45fe-4e26-a729-af6c826f1c75 req-6194b208-cd54-4621-b727-46870c76848f service nova] Acquiring lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ee659813-45fe-4e26-a729-af6c826f1c75 req-6194b208-cd54-4621-b727-46870c76848f service nova] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ee659813-45fe-4e26-a729-af6c826f1c75 req-6194b208-cd54-4621-b727-46870c76848f service nova] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-ee659813-45fe-4e26-a729-af6c826f1c75 req-6194b208-cd54-4621-b727-46870c76848f service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] No waiting events found dispatching network-vif-plugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:21:07 user nova-compute[72000]: WARNING nova.compute.manager [req-ee659813-45fe-4e26-a729-af6c826f1c75 req-6194b208-cd54-4621-b727-46870c76848f service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received unexpected event network-vif-plugged-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c for instance with vm_state active and task_state deleting.
Aug 16 18:21:08 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:21:08 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Took 1.74 seconds to deallocate network for instance.
Aug 16 18:21:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-ff7fb425-f544-4ad7-b366-1151e53a4888 req-59c78ef4-228f-4e3f-bdd5-cb7444f25fc4 service nova] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Received event network-vif-deleted-6ef2ad33-dfe7-4939-b548-3ff1c4b12b3c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:08 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:21:08 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:21:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:08 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Deleted allocations for instance ca0dfc09-f74e-4237-8759-a46b1842ee85
Aug 16 18:21:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7b938c3-f4e5-4b2b-b5a8-800996693396 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "ca0dfc09-f74e-4237-8759-a46b1842ee85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.212s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:21 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210066.3314621, ca0dfc09-f74e-4237-8759-a46b1842ee85 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:21:21 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] VM Stopped (Lifecycle Event)
Aug 16 18:21:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6f895ad9-0988-43c8-b30b-7b0f1c0fa997 None None] [instance: ca0dfc09-f74e-4237-8759-a46b1842ee85] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:21:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "966d4480-7413-43bc-9b0f-6a522e88908b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:21 user nova-compute[72000]: INFO nova.compute.manager [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Terminating instance
Aug 16 18:21:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-41461192-20ab-4288-a964-549117809c49 req-8b10af03-94b8-46be-b4bb-b1209f52bae1 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-vif-unplugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-41461192-20ab-4288-a964-549117809c49 req-8b10af03-94b8-46be-b4bb-b1209f52bae1 service nova] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-41461192-20ab-4288-a964-549117809c49 req-8b10af03-94b8-46be-b4bb-b1209f52bae1 service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-41461192-20ab-4288-a964-549117809c49 req-8b10af03-94b8-46be-b4bb-b1209f52bae1 service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-41461192-20ab-4288-a964-549117809c49 req-8b10af03-94b8-46be-b4bb-b1209f52bae1 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] No waiting events found dispatching network-vif-unplugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-41461192-20ab-4288-a964-549117809c49 req-8b10af03-94b8-46be-b4bb-b1209f52bae1 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-vif-unplugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Instance destroyed successfully.
Aug 16 18:21:22 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'resources' on Instance uuid 966d4480-7413-43bc-9b0f-6a522e88908b {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-698649144',display_name='tempest-ServerRescueNegativeTestJSON-server-698649144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-698649144',id=17,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-oj515vfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:06:56Z,user_data=None,user_id='d07d329987884ac98b87374ca2074b86',uuid=966d4480-7413-43bc-9b0f-6a522e88908b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "address": "fa:16:3e:18:cd:11", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6f8881b-d1", "ovs_interfaceid": "f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f8881b-d1') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG os_vif [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f8881b-d1') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6f8881b-d1, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:21:22 user nova-compute[72000]: INFO os_vif [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:cd:11,bridge_name='br-int',has_traffic_filtering=True,id=f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6f8881b-d1')
Aug 16 18:21:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Deleting instance files /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b_del
Aug 16 18:21:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Deletion of /opt/stack/data/nova/instances/966d4480-7413-43bc-9b0f-6a522e88908b_del complete
Aug 16 18:21:22 user nova-compute[72000]: INFO nova.compute.manager [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 16 18:21:22 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:21:22 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:21:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:23 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:21:23 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Took 0.96 seconds to deallocate network for instance.
Aug 16 18:21:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:23 user nova-compute[72000]: INFO nova.compute.manager [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Terminating instance
Aug 16 18:21:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:24 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Deleted allocations for instance 966d4480-7413-43bc-9b0f-6a522e88908b
Aug 16 18:21:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4f184f54-dd24-4a33-8e65-42db7313e27a tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "966d4480-7413-43bc-9b0f-6a522e88908b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.372s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] Acquiring lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] Lock "966d4480-7413-43bc-9b0f-6a522e88908b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] No waiting events found dispatching network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:21:24 user nova-compute[72000]: WARNING nova.compute.manager [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received unexpected event network-vif-plugged-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf for instance with vm_state deleted and task_state None.
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received event network-changed-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Refreshing instance network info cache due to event network-changed-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] Acquiring lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] Acquired lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.network.neutron [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Refreshing network info cache for port a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:24 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Instance destroyed successfully.
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.objects.instance [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lazy-loading 'resources' on Instance uuid 618b087f-3794-4508-bc46-a30f888525ec {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1240206507',display_name='tempest-TestStampPattern-server-1240206507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1240206507',id=27,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnL9X6wz3GwRD3jGjdqTIwmD/7nKpA3bWQ1ZIEuWHKZC1VpFYkzRFXTP/yQJ9fYNYYuFbJpkSkCeUgHRnAHArKDMODurNq3Vj+iMZJqARRn9GQICSStCAl47V2JXBmY1g==',key_name='tempest-TestStampPattern-2099348715',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6fe73c2955b4eddbbfd84bd9806ba88',ramdisk_id='',reservation_id='r-36b3u8l8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-463262942',owner_user_name='tempest-TestStampPattern-463262942-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:16:59Z,user_data=None,user_id='bce14217bd604140a4082ca9f6b862c0',uuid=618b087f-3794-4508-bc46-a30f888525ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converting VIF {"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:b7:01,bridge_name='br-int',has_traffic_filtering=True,id=a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f1b48d-6f') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG os_vif [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:b7:01,bridge_name='br-int',has_traffic_filtering=True,id=a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f1b48d-6f') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3f1b48d-6f, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:21:24 user nova-compute[72000]: INFO os_vif [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:b7:01,bridge_name='br-int',has_traffic_filtering=True,id=a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8,network=Network(5134bbd5-56da-46f9-b493-42108ba90e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f1b48d-6f')
Aug 16 18:21:24 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Deleting instance files /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec_del
Aug 16 18:21:24 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Deletion of /opt/stack/data/nova/instances/618b087f-3794-4508-bc46-a30f888525ec_del complete
Aug 16 18:21:24 user nova-compute[72000]: INFO nova.compute.manager [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 16 18:21:24 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:21:24 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 618b087f-3794-4508-bc46-a30f888525ec] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG nova.network.neutron [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Updated VIF entry in instance network info cache for port a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG nova.network.neutron [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Updating instance_info_cache with network_info: [{"id": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "address": "fa:16:3e:69:b7:01", "network": {"id": "5134bbd5-56da-46f9-b493-42108ba90e7b", "bridge": "br-int", "label": "tempest-TestStampPattern-847088395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6fe73c2955b4eddbbfd84bd9806ba88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f1b48d-6f", "ovs_interfaceid": "a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] Releasing lock "refresh_cache-618b087f-3794-4508-bc46-a30f888525ec" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Received event network-vif-deleted-f6f8881b-d1ca-4ac9-86ec-170b8bc2d2cf {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received event network-vif-unplugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] Lock "618b087f-3794-4508-bc46-a30f888525ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] Lock "618b087f-3794-4508-bc46-a30f888525ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] No waiting events found dispatching network-vif-unplugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-a0698f2b-90cc-4c84-908d-bee46b2f8d2c req-1fbc74dd-6db3-4041-95a7-5619d10d5859 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received event network-vif-unplugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:21:25 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Took 0.53 seconds to deallocate network for instance.
Aug 16 18:21:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-cadfd9b7-27a8-4bb5-83cd-0f1432b0e9e8 req-225a6dc8-26cd-4e46-bb13-51c8cc4cd59b service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received event network-vif-deleted-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:21:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:25 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Deleted allocations for instance 618b087f-3794-4508-bc46-a30f888525ec
Aug 16 18:21:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b4c6b690-2d62-4592-9c31-23903ab1005f tempest-TestStampPattern-463262942 tempest-TestStampPattern-463262942-project-member] Lock "618b087f-3794-4508-bc46-a30f888525ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.823s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:26 user nova-compute[72000]: DEBUG nova.compute.manager [req-256f820a-3c9f-4089-b6ef-1662993a6f20 req-19bed411-7215-419e-9991-f758c102a450 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received event network-vif-plugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-256f820a-3c9f-4089-b6ef-1662993a6f20 req-19bed411-7215-419e-9991-f758c102a450 service nova] Acquiring lock "618b087f-3794-4508-bc46-a30f888525ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-256f820a-3c9f-4089-b6ef-1662993a6f20 req-19bed411-7215-419e-9991-f758c102a450 service nova] Lock "618b087f-3794-4508-bc46-a30f888525ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-256f820a-3c9f-4089-b6ef-1662993a6f20 req-19bed411-7215-419e-9991-f758c102a450 service nova] Lock "618b087f-3794-4508-bc46-a30f888525ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:26 user nova-compute[72000]: DEBUG nova.compute.manager [req-256f820a-3c9f-4089-b6ef-1662993a6f20 req-19bed411-7215-419e-9991-f758c102a450 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] No waiting events found dispatching network-vif-plugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:21:26 user nova-compute[72000]: WARNING nova.compute.manager [req-256f820a-3c9f-4089-b6ef-1662993a6f20 req-19bed411-7215-419e-9991-f758c102a450 service nova] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Received unexpected event network-vif-plugged-a3f1b48d-6fc0-4e6f-945e-d776ba31b2b8 for instance with vm_state deleted and task_state None.
Aug 16 18:21:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:21:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:21:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:21:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:21:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:21:27 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:21:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:21:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:21:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:21:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:21:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "4eba3554-aa38-40b1-be49-c865c9d7b84d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:21:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:21:31 user nova-compute[72000]: INFO nova.compute.claims [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Claim successful on node user
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:21:32 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:21:32 user nova-compute[72000]: INFO nova.virt.block_device [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Booting with volume snapshot e0877dd1-15b1-41c9-8d99-f5e2d3791314 at /dev/vda
Aug 16 18:21:32 user nova-compute[72000]: DEBUG nova.policy [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1107151852b84f3185157fff0c0f3495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b758c455ec774042967fb617787c1cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Successfully created port: c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:21:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:33 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:21:33 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:21:33 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8414MB free_disk=23.74060821533203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:21:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Successfully updated port: c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "refresh_cache-4eba3554-aa38-40b1-be49-c865c9d7b84d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquired lock "refresh_cache-4eba3554-aa38-40b1-be49-c865c9d7b84d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4eba3554-aa38-40b1-be49-c865c9d7b84d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-6ac206e8-61d3-4eb5-8742-5c9d2e76a74a req-b1f4f218-9be6-44a5-b3dd-16fea16850dd service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Received event network-changed-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-6ac206e8-61d3-4eb5-8742-5c9d2e76a74a req-b1f4f218-9be6-44a5-b3dd-16fea16850dd service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Refreshing instance network info cache due to event network-changed-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6ac206e8-61d3-4eb5-8742-5c9d2e76a74a req-b1f4f218-9be6-44a5-b3dd-16fea16850dd service nova] Acquiring lock "refresh_cache-4eba3554-aa38-40b1-be49-c865c9d7b84d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Updating instance_info_cache with network_info: [{"id": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "address": "fa:16:3e:9e:0b:36", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ea4f12-b3", "ovs_interfaceid": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Releasing lock "refresh_cache-4eba3554-aa38-40b1-be49-c865c9d7b84d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Instance network_info: |[{"id": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "address": "fa:16:3e:9e:0b:36", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ea4f12-b3", "ovs_interfaceid": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6ac206e8-61d3-4eb5-8742-5c9d2e76a74a req-b1f4f218-9be6-44a5-b3dd-16fea16850dd service nova] Acquired lock "refresh_cache-4eba3554-aa38-40b1-be49-c865c9d7b84d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-6ac206e8-61d3-4eb5-8742-5c9d2e76a74a req-b1f4f218-9be6-44a5-b3dd-16fea16850dd service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Refreshing network info cache for port c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-6ac206e8-61d3-4eb5-8742-5c9d2e76a74a req-b1f4f218-9be6-44a5-b3dd-16fea16850dd service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Updated VIF entry in instance network info cache for port c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-6ac206e8-61d3-4eb5-8742-5c9d2e76a74a req-b1f4f218-9be6-44a5-b3dd-16fea16850dd service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Updating instance_info_cache with network_info: [{"id": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "address": "fa:16:3e:9e:0b:36", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ea4f12-b3", "ovs_interfaceid": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:21:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6ac206e8-61d3-4eb5-8742-5c9d2e76a74a req-b1f4f218-9be6-44a5-b3dd-16fea16850dd service nova] Releasing lock "refresh_cache-4eba3554-aa38-40b1-be49-c865c9d7b84d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:21:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:37 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210082.7739193, 966d4480-7413-43bc-9b0f-6a522e88908b => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:21:37 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] VM Stopped (Lifecycle Event)
Aug 16 18:21:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1f87480f-65df-48e3-a6ed-1a96ae77ac56 None None] [instance: 966d4480-7413-43bc-9b0f-6a522e88908b] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG os_brick.utils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfeaab6-ee6c-4a6f-8792-0eef35c47534]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84060bfe-9479-46d2-b54f-cafc15a6b388]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa50fbc-a93d-49a4-b271-ebc0bf4d4c08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca433a2f-35f7-4154-9ec4-c8295b9a38a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:21:38 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96b8610-b9c4-4ac5-97fe-08e0bc8c3645]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG os_brick.utils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Updating existing volume attachment record: 9ec4d15b-900e-40b9-bdb7-3b22e43a9667 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:21:39 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210084.7655985, 618b087f-3794-4508-bc46-a30f888525ec => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:21:39 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 618b087f-3794-4508-bc46-a30f888525ec] VM Stopped (Lifecycle Event)
Aug 16 18:21:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:21:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a5b7d090-d7a2-4d3b-be9e-4f75a8966ae6 None None] [instance: 618b087f-3794-4508-bc46-a30f888525ec] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:21:42 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:21:42 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:21:42 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:21:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:21:49 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Creating image(s)
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Ensure instance console log exists: /opt/stack/data/nova/instances/4eba3554-aa38-40b1-be49-c865c9d7b84d/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Start _get_guest_xml network_info=[{"id": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "address": "fa:16:3e:9e:0b:36", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ea4f12-b3", "ovs_interfaceid": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtAbQOKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4eba3554-aa38-40b1-be49-c865c9d7b84d', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba01771e-ea06-4536-92d8-7e75ffb224bf', 'serial': 'ba01771e-ea06-4536-92d8-7e75ffb224bf'}, 'attachment_id': '9ec4d15b-900e-40b9-bdb7-3b22e43a9667', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:21:49 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:21:49 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtAbQOKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:21:49 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:21:49 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:21:49 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1e9071-6c4f-41fb-b66d-3005b7209244]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:21:49 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe1dd3e-6e8b-4586-b2fd-393cd729a024]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf] added
Aug 16 18:21:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f318771e-eb05-4db8-b086-348d31c29298]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb774a5-97a8-46e3-a5be-33ffb67413fd]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vtAbQOKf {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vtAbQOKf" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2f7bc0-0810-41f5-a154-d14e4b0cfd75]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vtAbQOKf'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e37c44-5d3b-4f65-8ef6-e42e8dfcce9a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[728c137c-fa36-4284-98ee-0afc65119969]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:21:49 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:21:49 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:21:49 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 18:21:49 user nova-compute[72000]: 
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb735f-f5e2-46d4-926c-bcc888544406]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf, portal: 172.16.0.220,3260]
Aug 16 18:21:49 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf, portal: 172.16.0.220,3260] successful.
Aug 16 18:21:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8cbb53-91f3-417a-ae08-7970d03759f0]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca64d2b-2700-4e59-a121-39ca38d180cc]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf (non-flash)
Aug 16 18:21:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf (non-flash)
Aug 16 18:21:49 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed416fd8-4e4c-42f6-9c05-378e9d0fc48c]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:21:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtAbQOKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26538636335656466', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538636335656466', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1332163427',display_name='tempest-TestVolumeBootPattern-server-1332163427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1332163427',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-8ew49s5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:21:33Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=4eba3554-aa38-40b1-be49-c865c9d7b84d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "address": "fa:16:3e:9e:0b:36", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ea4f12-b3", "ovs_interfaceid": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "address": "fa:16:3e:9e:0b:36", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ea4f12-b3", "ovs_interfaceid": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0b:36,bridge_name='br-int',has_traffic_filtering=True,id=c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ea4f12-b3') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eba3554-aa38-40b1-be49-c865c9d7b84d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:21:50 user nova-compute[72000]:   <uuid>4eba3554-aa38-40b1-be49-c865c9d7b84d</uuid>
Aug 16 18:21:50 user nova-compute[72000]:   <name>instance-00000022</name>
Aug 16 18:21:50 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:21:50 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:21:50 user nova-compute[72000]:   <metadata>
Aug 16 18:21:50 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:21:50 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:21:50 user nova-compute[72000]:       <nova:name>tempest-TestVolumeBootPattern-server-1332163427</nova:name>
Aug 16 18:21:50 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:21:49</nova:creationTime>
Aug 16 18:21:50 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:21:50 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:21:50 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:21:50 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:21:50 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:21:50 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:21:50 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:21:50 user nova-compute[72000]:       <nova:owner>
Aug 16 18:21:50 user nova-compute[72000]:         <nova:user uuid="1107151852b84f3185157fff0c0f3495">tempest-TestVolumeBootPattern-109968882-project-member</nova:user>
Aug 16 18:21:50 user nova-compute[72000]:         <nova:project uuid="b758c455ec774042967fb617787c1cbd">tempest-TestVolumeBootPattern-109968882</nova:project>
Aug 16 18:21:50 user nova-compute[72000]:       </nova:owner>
Aug 16 18:21:50 user nova-compute[72000]:       <nova:ports>
Aug 16 18:21:50 user nova-compute[72000]:         <nova:port uuid="c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc">
Aug 16 18:21:50 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 16 18:21:50 user nova-compute[72000]:         </nova:port>
Aug 16 18:21:50 user nova-compute[72000]:       </nova:ports>
Aug 16 18:21:50 user nova-compute[72000]:     </nova:instance>
Aug 16 18:21:50 user nova-compute[72000]:   </metadata>
Aug 16 18:21:50 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:21:50 user nova-compute[72000]:     <system>
Aug 16 18:21:50 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:21:50 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:21:50 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:21:50 user nova-compute[72000]:       <entry name="serial">4eba3554-aa38-40b1-be49-c865c9d7b84d</entry>
Aug 16 18:21:50 user nova-compute[72000]:       <entry name="uuid">4eba3554-aa38-40b1-be49-c865c9d7b84d</entry>
Aug 16 18:21:50 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:21:50 user nova-compute[72000]:     </system>
Aug 16 18:21:50 user nova-compute[72000]:   </sysinfo>
Aug 16 18:21:50 user nova-compute[72000]:   <os>
Aug 16 18:21:50 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:21:50 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:21:50 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:21:50 user nova-compute[72000]:   </os>
Aug 16 18:21:50 user nova-compute[72000]:   <features>
Aug 16 18:21:50 user nova-compute[72000]:     <acpi/>
Aug 16 18:21:50 user nova-compute[72000]:     <apic/>
Aug 16 18:21:50 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:21:50 user nova-compute[72000]:   </features>
Aug 16 18:21:50 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:21:50 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:21:50 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:21:50 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:21:50 user nova-compute[72000]:   </clock>
Aug 16 18:21:50 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:21:50 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:21:50 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:21:50 user nova-compute[72000]:   </cpu>
Aug 16 18:21:50 user nova-compute[72000]:   <devices>
Aug 16 18:21:50 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:21:50 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:21:50 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 18:21:50 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:21:50 user nova-compute[72000]:       <serial>ba01771e-ea06-4536-92d8-7e75ffb224bf</serial>
Aug 16 18:21:50 user nova-compute[72000]:     </disk>
Aug 16 18:21:50 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:21:50 user nova-compute[72000]:       <mac address="fa:16:3e:9e:0b:36"/>
Aug 16 18:21:50 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:21:50 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:21:50 user nova-compute[72000]:       <target dev="tapc5ea4f12-b3"/>
Aug 16 18:21:50 user nova-compute[72000]:     </interface>
Aug 16 18:21:50 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:21:50 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/4eba3554-aa38-40b1-be49-c865c9d7b84d/console.log" append="off"/>
Aug 16 18:21:50 user nova-compute[72000]:     </serial>
Aug 16 18:21:50 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:21:50 user nova-compute[72000]:     <video>
Aug 16 18:21:50 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:21:50 user nova-compute[72000]:     </video>
Aug 16 18:21:50 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:21:50 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:21:50 user nova-compute[72000]:     </rng>
Aug 16 18:21:50 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:21:50 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:21:50 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:21:50 user nova-compute[72000]:     </memballoon>
Aug 16 18:21:50 user nova-compute[72000]:   </devices>
Aug 16 18:21:50 user nova-compute[72000]: </domain>
Aug 16 18:21:50 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1332163427',display_name='tempest-TestVolumeBootPattern-server-1332163427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1332163427',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-8ew49s5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:21:33Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=4eba3554-aa38-40b1-be49-c865c9d7b84d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "address": "fa:16:3e:9e:0b:36", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ea4f12-b3", "ovs_interfaceid": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "address": "fa:16:3e:9e:0b:36", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ea4f12-b3", "ovs_interfaceid": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0b:36,bridge_name='br-int',has_traffic_filtering=True,id=c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ea4f12-b3') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG os_vif [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0b:36,bridge_name='br-int',has_traffic_filtering=True,id=c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ea4f12-b3') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5ea4f12-b3, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5ea4f12-b3, col_values=(('external_ids', {'iface-id': 'c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:0b:36', 'vm-uuid': '4eba3554-aa38-40b1-be49-c865c9d7b84d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:50 user nova-compute[72000]: INFO os_vif [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0b:36,bridge_name='br-int',has_traffic_filtering=True,id=c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ea4f12-b3')
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:21:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No VIF found with MAC fa:16:3e:9e:0b:36, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:21:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-ade1514d-633a-4695-a511-8a7ae660e767 req-cac647b6-fb16-4fda-ad55-51653d2fcf34 service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Received event network-vif-plugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ade1514d-633a-4695-a511-8a7ae660e767 req-cac647b6-fb16-4fda-ad55-51653d2fcf34 service nova] Acquiring lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ade1514d-633a-4695-a511-8a7ae660e767 req-cac647b6-fb16-4fda-ad55-51653d2fcf34 service nova] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ade1514d-633a-4695-a511-8a7ae660e767 req-cac647b6-fb16-4fda-ad55-51653d2fcf34 service nova] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-ade1514d-633a-4695-a511-8a7ae660e767 req-cac647b6-fb16-4fda-ad55-51653d2fcf34 service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] No waiting events found dispatching network-vif-plugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:21:52 user nova-compute[72000]: WARNING nova.compute.manager [req-ade1514d-633a-4695-a511-8a7ae660e767 req-cac647b6-fb16-4fda-ad55-51653d2fcf34 service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Received unexpected event network-vif-plugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc for instance with vm_state building and task_state spawning.
Aug 16 18:21:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.compute.manager [req-7c38646c-a3ec-4bc8-bf4e-976b6886d201 req-4b63a1af-bf98-456b-ba74-80b020cbf0fb service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Received event network-vif-plugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7c38646c-a3ec-4bc8-bf4e-976b6886d201 req-4b63a1af-bf98-456b-ba74-80b020cbf0fb service nova] Acquiring lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7c38646c-a3ec-4bc8-bf4e-976b6886d201 req-4b63a1af-bf98-456b-ba74-80b020cbf0fb service nova] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7c38646c-a3ec-4bc8-bf4e-976b6886d201 req-4b63a1af-bf98-456b-ba74-80b020cbf0fb service nova] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.compute.manager [req-7c38646c-a3ec-4bc8-bf4e-976b6886d201 req-4b63a1af-bf98-456b-ba74-80b020cbf0fb service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] No waiting events found dispatching network-vif-plugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:21:54 user nova-compute[72000]: WARNING nova.compute.manager [req-7c38646c-a3ec-4bc8-bf4e-976b6886d201 req-4b63a1af-bf98-456b-ba74-80b020cbf0fb service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Received unexpected event network-vif-plugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc for instance with vm_state building and task_state spawning.
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210114.413902, 4eba3554-aa38-40b1-be49-c865c9d7b84d => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:21:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] VM Resumed (Lifecycle Event)
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:21:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Instance spawned successfully.
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:21:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210114.4230087, 4eba3554-aa38-40b1-be49-c865c9d7b84d => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:21:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] VM Started (Lifecycle Event)
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:21:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:21:54 user nova-compute[72000]: INFO nova.compute.manager [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Took 5.25 seconds to spawn the instance on the hypervisor.
Aug 16 18:21:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:21:54 user nova-compute[72000]: INFO nova.compute.manager [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Took 23.09 seconds to build instance.
Aug 16 18:21:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4b3e9049-fe6c-4f89-afc6-801e790559dd tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.209s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:21:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:21:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "5849da70-0ea4-4ddb-b333-874e98527b6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:22:00 user nova-compute[72000]: INFO nova.compute.claims [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Claim successful on node user
Aug 16 18:22:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:22:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:22:00 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:22:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG nova.policy [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfe1063b05894bfeb8f08bc29602b2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b557a84c43a47db90c0eb7054a77446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:22:01 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Creating image(s)
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "/opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "/opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "/opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.286s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk 1073741824" returned: 0 in 0.059s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Successfully created port: 6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Cannot resize image /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:22:01 user nova-compute[72000]: DEBUG nova.objects.instance [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'migration_context' on Instance uuid 5849da70-0ea4-4ddb-b333-874e98527b6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Ensure instance console log exists: /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Successfully updated port: 6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquired lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-a1f45092-63ea-45d0-8aea-fbbc1a807af6 req-540f55df-8da2-417b-b082-24275b17efda service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received event network-changed-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-a1f45092-63ea-45d0-8aea-fbbc1a807af6 req-540f55df-8da2-417b-b082-24275b17efda service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Refreshing instance network info cache due to event network-changed-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:22:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a1f45092-63ea-45d0-8aea-fbbc1a807af6 req-540f55df-8da2-417b-b082-24275b17efda service nova] Acquiring lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Updating instance_info_cache with network_info: [{"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Releasing lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Instance network_info: |[{"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a1f45092-63ea-45d0-8aea-fbbc1a807af6 req-540f55df-8da2-417b-b082-24275b17efda service nova] Acquired lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-a1f45092-63ea-45d0-8aea-fbbc1a807af6 req-540f55df-8da2-417b-b082-24275b17efda service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Refreshing network info cache for port 6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Start _get_guest_xml network_info=[{"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:22:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:22:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2000231875',display_name='tempest-AttachVolumeNegativeTest-server-2000231875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2000231875',id=35,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgV+svyxNjDLZpfWHC4uREbcgJ6RT9x19MlM0IcmTMRt51EDSbr9NoHgLsI4/uPC31jaF94v+CVvXnIs89AFZBXZFzW46es2mP02NaMt0vK6wiEdYtoK/AGR7uPX7lmjA==',key_name='tempest-keypair-929221982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-jbk3g4vg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:22:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=5849da70-0ea4-4ddb-b333-874e98527b6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a2c5b0f-52') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'pci_devices' on Instance uuid 5849da70-0ea4-4ddb-b333-874e98527b6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:22:03 user nova-compute[72000]:   <uuid>5849da70-0ea4-4ddb-b333-874e98527b6d</uuid>
Aug 16 18:22:03 user nova-compute[72000]:   <name>instance-00000023</name>
Aug 16 18:22:03 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:22:03 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:22:03 user nova-compute[72000]:   <metadata>
Aug 16 18:22:03 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:22:03 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:22:03 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2000231875</nova:name>
Aug 16 18:22:03 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:22:03</nova:creationTime>
Aug 16 18:22:03 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:22:03 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:22:03 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:22:03 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:22:03 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:22:03 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:22:03 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:22:03 user nova-compute[72000]:       <nova:owner>
Aug 16 18:22:03 user nova-compute[72000]:         <nova:user uuid="cfe1063b05894bfeb8f08bc29602b2fa">tempest-AttachVolumeNegativeTest-678349136-project-member</nova:user>
Aug 16 18:22:03 user nova-compute[72000]:         <nova:project uuid="9b557a84c43a47db90c0eb7054a77446">tempest-AttachVolumeNegativeTest-678349136</nova:project>
Aug 16 18:22:03 user nova-compute[72000]:       </nova:owner>
Aug 16 18:22:03 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:22:03 user nova-compute[72000]:       <nova:ports>
Aug 16 18:22:03 user nova-compute[72000]:         <nova:port uuid="6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe">
Aug 16 18:22:03 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:22:03 user nova-compute[72000]:         </nova:port>
Aug 16 18:22:03 user nova-compute[72000]:       </nova:ports>
Aug 16 18:22:03 user nova-compute[72000]:     </nova:instance>
Aug 16 18:22:03 user nova-compute[72000]:   </metadata>
Aug 16 18:22:03 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:22:03 user nova-compute[72000]:     <system>
Aug 16 18:22:03 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:22:03 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:22:03 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:22:03 user nova-compute[72000]:       <entry name="serial">5849da70-0ea4-4ddb-b333-874e98527b6d</entry>
Aug 16 18:22:03 user nova-compute[72000]:       <entry name="uuid">5849da70-0ea4-4ddb-b333-874e98527b6d</entry>
Aug 16 18:22:03 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:22:03 user nova-compute[72000]:     </system>
Aug 16 18:22:03 user nova-compute[72000]:   </sysinfo>
Aug 16 18:22:03 user nova-compute[72000]:   <os>
Aug 16 18:22:03 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:22:03 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:22:03 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:22:03 user nova-compute[72000]:   </os>
Aug 16 18:22:03 user nova-compute[72000]:   <features>
Aug 16 18:22:03 user nova-compute[72000]:     <acpi/>
Aug 16 18:22:03 user nova-compute[72000]:     <apic/>
Aug 16 18:22:03 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:22:03 user nova-compute[72000]:   </features>
Aug 16 18:22:03 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:22:03 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:22:03 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:22:03 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:22:03 user nova-compute[72000]:   </clock>
Aug 16 18:22:03 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:22:03 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:22:03 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:22:03 user nova-compute[72000]:   </cpu>
Aug 16 18:22:03 user nova-compute[72000]:   <devices>
Aug 16 18:22:03 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:22:03 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:22:03 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk"/>
Aug 16 18:22:03 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:22:03 user nova-compute[72000]:     </disk>
Aug 16 18:22:03 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:22:03 user nova-compute[72000]:       <mac address="fa:16:3e:c5:9f:18"/>
Aug 16 18:22:03 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:22:03 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:22:03 user nova-compute[72000]:       <target dev="tap6a2c5b0f-52"/>
Aug 16 18:22:03 user nova-compute[72000]:     </interface>
Aug 16 18:22:03 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:22:03 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/console.log" append="off"/>
Aug 16 18:22:03 user nova-compute[72000]:     </serial>
Aug 16 18:22:03 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:22:03 user nova-compute[72000]:     <video>
Aug 16 18:22:03 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:22:03 user nova-compute[72000]:     </video>
Aug 16 18:22:03 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:22:03 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:22:03 user nova-compute[72000]:     </rng>
Aug 16 18:22:03 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:22:03 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:22:03 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:22:03 user nova-compute[72000]:     </memballoon>
Aug 16 18:22:03 user nova-compute[72000]:   </devices>
Aug 16 18:22:03 user nova-compute[72000]: </domain>
Aug 16 18:22:03 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2000231875',display_name='tempest-AttachVolumeNegativeTest-server-2000231875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2000231875',id=35,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgV+svyxNjDLZpfWHC4uREbcgJ6RT9x19MlM0IcmTMRt51EDSbr9NoHgLsI4/uPC31jaF94v+CVvXnIs89AFZBXZFzW46es2mP02NaMt0vK6wiEdYtoK/AGR7uPX7lmjA==',key_name='tempest-keypair-929221982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-jbk3g4vg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:22:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=5849da70-0ea4-4ddb-b333-874e98527b6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a2c5b0f-52') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG os_vif [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a2c5b0f-52') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a2c5b0f-52, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a2c5b0f-52, col_values=(('external_ids', {'iface-id': '6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:9f:18', 'vm-uuid': '5849da70-0ea4-4ddb-b333-874e98527b6d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:03 user nova-compute[72000]: INFO os_vif [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a2c5b0f-52')
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No VIF found with MAC fa:16:3e:c5:9f:18, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-a1f45092-63ea-45d0-8aea-fbbc1a807af6 req-540f55df-8da2-417b-b082-24275b17efda service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Updated VIF entry in instance network info cache for port 6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-a1f45092-63ea-45d0-8aea-fbbc1a807af6 req-540f55df-8da2-417b-b082-24275b17efda service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Updating instance_info_cache with network_info: [{"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:22:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a1f45092-63ea-45d0-8aea-fbbc1a807af6 req-540f55df-8da2-417b-b082-24275b17efda service nova] Releasing lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:22:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-dfb54247-f78b-4328-8ad7-9209c9937426 req-13283be9-ba5f-4eb6-b763-80d697a13926 service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received event network-vif-plugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:22:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dfb54247-f78b-4328-8ad7-9209c9937426 req-13283be9-ba5f-4eb6-b763-80d697a13926 service nova] Acquiring lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dfb54247-f78b-4328-8ad7-9209c9937426 req-13283be9-ba5f-4eb6-b763-80d697a13926 service nova] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-dfb54247-f78b-4328-8ad7-9209c9937426 req-13283be9-ba5f-4eb6-b763-80d697a13926 service nova] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-dfb54247-f78b-4328-8ad7-9209c9937426 req-13283be9-ba5f-4eb6-b763-80d697a13926 service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] No waiting events found dispatching network-vif-plugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:22:05 user nova-compute[72000]: WARNING nova.compute.manager [req-dfb54247-f78b-4328-8ad7-9209c9937426 req-13283be9-ba5f-4eb6-b763-80d697a13926 service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received unexpected event network-vif-plugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe for instance with vm_state building and task_state spawning.
Aug 16 18:22:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-5463d159-0d94-4446-b890-a72c81b70fbb req-acdd7850-7ce5-4fe5-a5d6-4824fe2bd4a4 service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received event network-vif-plugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5463d159-0d94-4446-b890-a72c81b70fbb req-acdd7850-7ce5-4fe5-a5d6-4824fe2bd4a4 service nova] Acquiring lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5463d159-0d94-4446-b890-a72c81b70fbb req-acdd7850-7ce5-4fe5-a5d6-4824fe2bd4a4 service nova] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5463d159-0d94-4446-b890-a72c81b70fbb req-acdd7850-7ce5-4fe5-a5d6-4824fe2bd4a4 service nova] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-5463d159-0d94-4446-b890-a72c81b70fbb req-acdd7850-7ce5-4fe5-a5d6-4824fe2bd4a4 service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] No waiting events found dispatching network-vif-plugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:22:07 user nova-compute[72000]: WARNING nova.compute.manager [req-5463d159-0d94-4446-b890-a72c81b70fbb req-acdd7850-7ce5-4fe5-a5d6-4824fe2bd4a4 service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received unexpected event network-vif-plugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe for instance with vm_state building and task_state spawning.
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210127.3139198, 5849da70-0ea4-4ddb-b333-874e98527b6d => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:22:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] VM Resumed (Lifecycle Event)
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:22:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Instance spawned successfully.
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:22:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210127.315112, 5849da70-0ea4-4ddb-b333-874e98527b6d => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:22:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] VM Started (Lifecycle Event)
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:22:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:22:07 user nova-compute[72000]: INFO nova.compute.manager [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 16 18:22:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:22:07 user nova-compute[72000]: INFO nova.compute.manager [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Took 7.09 seconds to build instance.
Aug 16 18:22:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-41538dba-8483-4026-a629-50098549f207 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.218s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:12 user nova-compute[72000]: INFO nova.compute.manager [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Terminating instance
Aug 16 18:22:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:22:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-c98597a0-c1b7-41e1-bbce-7a4a139f805f req-5659f11a-974b-4bb3-883c-d5b2e0a05775 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c98597a0-c1b7-41e1-bbce-7a4a139f805f req-5659f11a-974b-4bb3-883c-d5b2e0a05775 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c98597a0-c1b7-41e1-bbce-7a4a139f805f req-5659f11a-974b-4bb3-883c-d5b2e0a05775 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c98597a0-c1b7-41e1-bbce-7a4a139f805f req-5659f11a-974b-4bb3-883c-d5b2e0a05775 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-c98597a0-c1b7-41e1-bbce-7a4a139f805f req-5659f11a-974b-4bb3-883c-d5b2e0a05775 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-c98597a0-c1b7-41e1-bbce-7a4a139f805f req-5659f11a-974b-4bb3-883c-d5b2e0a05775 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Instance destroyed successfully.
Aug 16 18:22:13 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lazy-loading 'resources' on Instance uuid 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1571244693',display_name='tempest-ServerRescueNegativeTestJSON-server-1571244693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1571244693',id=16,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5442ba2319584631a81b2d1208b5f65f',ramdisk_id='',reservation_id='r-pxsrqr84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1605720785',owner_user_name='tempest-ServerRescueNegativeTestJSON-1605720785-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:11:44Z,user_data=None,user_id='d07d329987884ac98b87374ca2074b86',uuid=4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converting VIF {"id": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "address": "fa:16:3e:0b:57:ff", "network": {"id": "bb83d428-31f3-4220-b7cb-5bc1a2153230", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1257889868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5442ba2319584631a81b2d1208b5f65f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb091dac-a7", "ovs_interfaceid": "cb091dac-a7ef-4da6-a4c3-b0e1977f7350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=cb091dac-a7ef-4da6-a4c3-b0e1977f7350,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb091dac-a7') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG os_vif [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=cb091dac-a7ef-4da6-a4c3-b0e1977f7350,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb091dac-a7') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb091dac-a7, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:13 user nova-compute[72000]: INFO os_vif [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:57:ff,bridge_name='br-int',has_traffic_filtering=True,id=cb091dac-a7ef-4da6-a4c3-b0e1977f7350,network=Network(bb83d428-31f3-4220-b7cb-5bc1a2153230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb091dac-a7')
Aug 16 18:22:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Deleting instance files /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716_del
Aug 16 18:22:13 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Deletion of /opt/stack/data/nova/instances/4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716_del complete
Aug 16 18:22:13 user nova-compute[72000]: INFO nova.compute.manager [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 16 18:22:13 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:22:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:14 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:22:14 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Took 1.30 seconds to deallocate network for instance.
Aug 16 18:22:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-5e54c696-9431-470b-99e3-cae55d4fb56e req-8180703a-4ade-4a26-bcf5-45dbafe80ba5 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-deleted-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:22:14 user nova-compute[72000]: INFO nova.compute.manager [req-5e54c696-9431-470b-99e3-cae55d4fb56e req-8180703a-4ade-4a26-bcf5-45dbafe80ba5 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Neutron deleted interface cb091dac-a7ef-4da6-a4c3-b0e1977f7350; detaching it from the instance and deleting it from the info cache
Aug 16 18:22:14 user nova-compute[72000]: DEBUG nova.network.neutron [req-5e54c696-9431-470b-99e3-cae55d4fb56e req-8180703a-4ade-4a26-bcf5-45dbafe80ba5 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:22:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-5e54c696-9431-470b-99e3-cae55d4fb56e req-8180703a-4ade-4a26-bcf5-45dbafe80ba5 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Detach interface failed, port_id=cb091dac-a7ef-4da6-a4c3-b0e1977f7350, reason: Instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:22:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:15 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Deleted allocations for instance 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:22:15 user nova-compute[72000]: WARNING nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state deleted and task_state None.
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:22:15 user nova-compute[72000]: WARNING nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state deleted and task_state None.
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:22:15 user nova-compute[72000]: WARNING nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state deleted and task_state None.
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:22:15 user nova-compute[72000]: WARNING nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-unplugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state deleted and task_state None.
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Acquiring lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:15 user nova-compute[72000]: DEBUG nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] No waiting events found dispatching network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:22:15 user nova-compute[72000]: WARNING nova.compute.manager [req-d0ad5051-ccc4-4ccb-abb9-a3ae65fce6d2 req-7e9932de-ad18-4273-b4ae-ba7ebeb6f387 service nova] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Received unexpected event network-vif-plugged-cb091dac-a7ef-4da6-a4c3-b0e1977f7350 for instance with vm_state deleted and task_state None.
Aug 16 18:22:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a79832e9-ea6a-4203-ae60-a73928d65045 tempest-ServerRescueNegativeTestJSON-1605720785 tempest-ServerRescueNegativeTestJSON-1605720785-project-member] Lock "4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.824s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:22:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:22:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:22:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:22:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:22:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:28 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210133.2896435, 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:22:28 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] VM Stopped (Lifecycle Event)
Aug 16 18:22:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2bb1adae-19ce-4810-b0ab-0fcddee40a5b None None] [instance: 4a1f5a1d-08bb-47f2-b3fb-d9cb4de49716] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:22:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:29 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:22:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:22:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:22:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:22:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:22:30 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updating instance_info_cache with network_info: [{"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:22:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-cef1b726-614c-4b75-8b44-5bc62f235424" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:22:30 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:22:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:22:30 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:22:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:22:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:22:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:34 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:22:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:22:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:22:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:22:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:22:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:22:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:22:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:22:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:22:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:22:35 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:22:35 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:22:35 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8223MB free_disk=23.72600555419922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:22:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:22:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:22:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:22:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 4eba3554-aa38-40b1-be49-c865c9d7b84d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:22:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 5849da70-0ea4-4ddb-b333-874e98527b6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:22:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:22:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:22:36 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:22:36 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:22:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:22:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:22:37 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:22:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:22:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:22:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:23:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:23:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:23:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "4eba3554-aa38-40b1-be49-c865c9d7b84d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:23:22 user nova-compute[72000]: INFO nova.compute.manager [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Terminating instance
Aug 16 18:23:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-975fd4f1-7ebc-4a05-b72a-f55872923683 req-f971f8dc-56a3-46f8-8de5-99aa12ae05c4 service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Received event network-vif-unplugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-975fd4f1-7ebc-4a05-b72a-f55872923683 req-f971f8dc-56a3-46f8-8de5-99aa12ae05c4 service nova] Acquiring lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-975fd4f1-7ebc-4a05-b72a-f55872923683 req-f971f8dc-56a3-46f8-8de5-99aa12ae05c4 service nova] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-975fd4f1-7ebc-4a05-b72a-f55872923683 req-f971f8dc-56a3-46f8-8de5-99aa12ae05c4 service nova] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-975fd4f1-7ebc-4a05-b72a-f55872923683 req-f971f8dc-56a3-46f8-8de5-99aa12ae05c4 service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] No waiting events found dispatching network-vif-unplugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:23:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-975fd4f1-7ebc-4a05-b72a-f55872923683 req-f971f8dc-56a3-46f8-8de5-99aa12ae05c4 service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Received event network-vif-unplugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:23:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Instance destroyed successfully.
Aug 16 18:23:23 user nova-compute[72000]: DEBUG nova.objects.instance [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'resources' on Instance uuid 4eba3554-aa38-40b1-be49-c865c9d7b84d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1332163427',display_name='tempest-TestVolumeBootPattern-server-1332163427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1332163427',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-8ew49s5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:21:55Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=4eba3554-aa38-40b1-be49-c865c9d7b84d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "address": "fa:16:3e:9e:0b:36", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ea4f12-b3", "ovs_interfaceid": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "address": "fa:16:3e:9e:0b:36", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ea4f12-b3", "ovs_interfaceid": "c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0b:36,bridge_name='br-int',has_traffic_filtering=True,id=c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ea4f12-b3') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_vif [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0b:36,bridge_name='br-int',has_traffic_filtering=True,id=c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ea4f12-b3') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5ea4f12-b3, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:23 user nova-compute[72000]: INFO os_vif [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0b:36,bridge_name='br-int',has_traffic_filtering=True,id=c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ea4f12-b3')
Aug 16 18:23:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtAbQOKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:23:23 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cb1b86-e6ba-4d1b-80cf-d474b3bb5fdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e445c44a-1521-4359-925f-1aa1a586738c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc9b463e-5fe7-4248-96b1-507cf462a50d\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ad4857-c28b-4d00-8f7f-7ae7423bf7e0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc9b463e-5fe7-4248-96b1-507cf462a50d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e445c44a-1521-4359-925f-1aa1a586738c (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf (non-flash)
Aug 16 18:23:23 user nova-compute[72000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc9b463e-5fe7-4248-96b1-507cf462a50d (non-flash)
Aug 16 18:23:23 user nova-compute[72000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e445c44a-1521-4359-925f-1aa1a586738c (non-flash)
Aug 16 18:23:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf (non-flash)
Aug 16 18:23:23 user nova-compute[72000]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc9b463e-5fe7-4248-96b1-507cf462a50d (non-flash)
Aug 16 18:23:23 user nova-compute[72000]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e445c44a-1521-4359-925f-1aa1a586738c (non-flash)
Aug 16 18:23:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01c85d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad5217e-e11b-489c-85b3-920fbf18f0ae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[797879ad-72d4-4a56-901d-c8265f3a2dbc]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceefee7c-3f69-4462-b188-13f6745e5828]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4130cea-c88e-472f-9084-5b723a750883]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6a35a97c', '/dev/disk/by-id/scsi-1SCST_BIO6a35a97c-e8cc5edf7888127c', '/dev/disk/by-id/scsi-26538636335656466') {{(pid=83463) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae1ed33-b6b8-437f-91c0-ee1269c8de21]: (4, None) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bc2113-877d-4551-8b60-86991dc40b50]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dac183-2036-40fc-8726-46a5608fd06b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf, portal: 172.16.0.220,3260]
Aug 16 18:23:23 user nova-compute[72000]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf, portal: 172.16.0.220,3260] successful.
Aug 16 18:23:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba01771e-ea06-4536-92d8-7e75ffb224bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb13c711-fc87-4826-84a2-816a74722c8a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== disconnect_volume: return (305ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:23:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Deleting instance files /opt/stack/data/nova/instances/4eba3554-aa38-40b1-be49-c865c9d7b84d_del
Aug 16 18:23:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Deletion of /opt/stack/data/nova/instances/4eba3554-aa38-40b1-be49-c865c9d7b84d_del complete
Aug 16 18:23:23 user nova-compute[72000]: INFO nova.compute.manager [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 16 18:23:23 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:23:23 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:23:23 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Took 0.49 seconds to deallocate network for instance.
Aug 16 18:23:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-6d0b0188-851c-4ad7-a1ce-a0e1874ba186 req-ca62f549-302f-4dc3-8a64-a6ca1b81782d service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Received event network-vif-plugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:23:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6d0b0188-851c-4ad7-a1ce-a0e1874ba186 req-ca62f549-302f-4dc3-8a64-a6ca1b81782d service nova] Acquiring lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:23:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6d0b0188-851c-4ad7-a1ce-a0e1874ba186 req-ca62f549-302f-4dc3-8a64-a6ca1b81782d service nova] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:23:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6d0b0188-851c-4ad7-a1ce-a0e1874ba186 req-ca62f549-302f-4dc3-8a64-a6ca1b81782d service nova] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:23:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-6d0b0188-851c-4ad7-a1ce-a0e1874ba186 req-ca62f549-302f-4dc3-8a64-a6ca1b81782d service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] No waiting events found dispatching network-vif-plugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:23:24 user nova-compute[72000]: WARNING nova.compute.manager [req-6d0b0188-851c-4ad7-a1ce-a0e1874ba186 req-ca62f549-302f-4dc3-8a64-a6ca1b81782d service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Received unexpected event network-vif-plugged-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc for instance with vm_state active and task_state deleting.
Aug 16 18:23:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-6d0b0188-851c-4ad7-a1ce-a0e1874ba186 req-ca62f549-302f-4dc3-8a64-a6ca1b81782d service nova] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Received event network-vif-deleted-c5ea4f12-b3b2-403d-90c5-98fe22a3d1fc {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:23:24 user nova-compute[72000]: INFO nova.compute.manager [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Took 0.84 seconds to detach 1 volumes for instance.
Aug 16 18:23:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Deleting volume: ba01771e-ea06-4536-92d8-7e75ffb224bf {{(pid=72000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 18:23:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:23:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:23:25 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:23:25 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:23:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:23:25 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Deleted allocations for instance 4eba3554-aa38-40b1-be49-c865c9d7b84d
Aug 16 18:23:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-05a29977-b127-4427-925e-4184eb5d26a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "4eba3554-aa38-40b1-be49-c865c9d7b84d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.046s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:23:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:23:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:23:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:23:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:23:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:23:30 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:23:30 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:23:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:23:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:23:30 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:23:30 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:23:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:23:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:23:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:23:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:23:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:23:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:23:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:23:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:23:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:23:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:23:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:23:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:23:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:23:34 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:23:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:23:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:23:35 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:23:35 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:23:35 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8458MB free_disk=23.72222137451172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:23:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:23:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:23:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:23:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 5849da70-0ea4-4ddb-b333-874e98527b6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:23:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:23:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:23:36 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:23:36 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:23:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:23:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:23:38 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210203.0261655, 4eba3554-aa38-40b1-be49-c865c9d7b84d => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:23:38 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] VM Stopped (Lifecycle Event)
Aug 16 18:23:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b120d9ec-e11d-4d06-902f-fe2561d1395c None None] [instance: 4eba3554-aa38-40b1-be49-c865c9d7b84d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:23:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:23:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:23:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:23:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:23:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-4f63936a-5991-491b-bc73-2173f65838ae req-4fd9dc09-e693-4751-bde5-3fe27718896d service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received event network-changed-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:23:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-4f63936a-5991-491b-bc73-2173f65838ae req-4fd9dc09-e693-4751-bde5-3fe27718896d service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Refreshing instance network info cache due to event network-changed-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:23:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4f63936a-5991-491b-bc73-2173f65838ae req-4fd9dc09-e693-4751-bde5-3fe27718896d service nova] Acquiring lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:23:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4f63936a-5991-491b-bc73-2173f65838ae req-4fd9dc09-e693-4751-bde5-3fe27718896d service nova] Acquired lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:23:51 user nova-compute[72000]: DEBUG nova.network.neutron [req-4f63936a-5991-491b-bc73-2173f65838ae req-4fd9dc09-e693-4751-bde5-3fe27718896d service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Refreshing network info cache for port 6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:23:51 user nova-compute[72000]: DEBUG nova.network.neutron [req-4f63936a-5991-491b-bc73-2173f65838ae req-4fd9dc09-e693-4751-bde5-3fe27718896d service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Updated VIF entry in instance network info cache for port 6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:23:51 user nova-compute[72000]: DEBUG nova.network.neutron [req-4f63936a-5991-491b-bc73-2173f65838ae req-4fd9dc09-e693-4751-bde5-3fe27718896d service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Updating instance_info_cache with network_info: [{"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:23:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4f63936a-5991-491b-bc73-2173f65838ae req-4fd9dc09-e693-4751-bde5-3fe27718896d service nova] Releasing lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:23:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:23:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:23:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "5849da70-0ea4-4ddb-b333-874e98527b6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:00 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'flavor' on Instance uuid 5849da70-0ea4-4ddb-b333-874e98527b6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:24:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "5849da70-0ea4-4ddb-b333-874e98527b6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:01 user nova-compute[72000]: INFO nova.compute.manager [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Attaching volume e5cdb258-56de-429d-a561-2e1a8994a557 to /dev/vdb
Aug 16 18:24:01 user nova-compute[72000]: DEBUG os_brick.utils [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe85488c-5867-4803-a030-a6a31158c84f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e3d45b-4d79-4eec-83fa-c52cb43a5e37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[478185f9-516c-4b04-80c5-2344294fe137]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5862da60-5ab4-4b20-9a5b-7a05569098f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:24:01 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:24:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc7bf2e-5ee2-48d6-86b4-0986e01eeb50]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG os_brick.utils [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:24:01 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Updating existing volume attachment record: 0d7ba25f-f528-4b2e-ae6e-2bd422f4ab96 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:24:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNBlOUVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:24:23 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:24:23 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:24:23 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45f7c99-d1a0-4b3f-9452-b5ddbc0d762c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:24:23 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7deb7f2-518b-458a-a707-5ee94f01968d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557] added
Aug 16 18:24:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44a0519-fa77-435c-8e3d-9696af478a0d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[596f0088-5908-435d-887b-d3c7ca27d3c6]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNBlOUVR {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNBlOUVR" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8d1536-e12e-4b7a-a09a-f1da96450c30]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNBlOUVR'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[03268c2b-10d5-4e10-93bc-657559d92d85]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a464b6e-d1b0-4448-8349-b67f078bc54d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:24:23 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:24:23 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:24:23 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 18:24:23 user nova-compute[72000]: 
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[703c6a68-4ddd-4bf3-9b03-333734c34881]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557, portal: 172.16.0.220,3260]
Aug 16 18:24:23 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557, portal: 172.16.0.220,3260] successful.
Aug 16 18:24:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[028c4d03-67f4-47c7-9c4d-f8c6d6790615]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[23af2d83-b21b-4f90-90f2-2043114876a5]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 (non-flash)
Aug 16 18:24:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 (non-flash)
Aug 16 18:24:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[464f0e04-3db6-4b0f-a35f-80a711046e8b]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:24:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNBlOUVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:24:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:24:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:24:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23435646262336661', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:24:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435646262336661', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:24:24 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'flavor' on Instance uuid 5849da70-0ea4-4ddb-b333-874e98527b6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:24:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:24:24 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:24:24 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:24:24 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:24:24 user nova-compute[72000]:   <serial>e5cdb258-56de-429d-a561-2e1a8994a557</serial>
Aug 16 18:24:24 user nova-compute[72000]: </disk>
Aug 16 18:24:24 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:24:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:24:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:24:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No VIF found with MAC fa:16:3e:c5:9f:18, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:24:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ea8be1cc-ee8f-411b-83ca-348f88c0f4bd tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.414s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:24:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "5849da70-0ea4-4ddb-b333-874e98527b6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:26 user nova-compute[72000]: INFO nova.compute.manager [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Detaching volume e5cdb258-56de-429d-a561-2e1a8994a557
Aug 16 18:24:26 user nova-compute[72000]: INFO nova.virt.block_device [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Attempting to driver detach volume e5cdb258-56de-429d-a561-2e1a8994a557 from mountpoint /dev/vdb
Aug 16 18:24:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Attempting to detach device vdb from instance 5849da70-0ea4-4ddb-b333-874e98527b6d from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:24:26 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:24:26 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:24:26 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:24:26 user nova-compute[72000]:   <serial>e5cdb258-56de-429d-a561-2e1a8994a557</serial>
Aug 16 18:24:26 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:24:26 user nova-compute[72000]: </disk>
Aug 16 18:24:26 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:24:26 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully detached device vdb from instance 5849da70-0ea4-4ddb-b333-874e98527b6d from the persistent domain config.
Aug 16 18:24:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5849da70-0ea4-4ddb-b333-874e98527b6d from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:24:26 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:24:26 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 18:24:26 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:24:26 user nova-compute[72000]:   <serial>e5cdb258-56de-429d-a561-2e1a8994a557</serial>
Aug 16 18:24:26 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:24:26 user nova-compute[72000]: </disk>
Aug 16 18:24:26 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692210266.7507422, 5849da70-0ea4-4ddb-b333-874e98527b6d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5849da70-0ea4-4ddb-b333-874e98527b6d {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:24:26 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully detached device vdb from instance 5849da70-0ea4-4ddb-b333-874e98527b6d from the live domain config.
Aug 16 18:24:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNBlOUVR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:24:26 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[660852d4-cc41-41f4-aa88-2a7da5f98f23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de33c259-1c4d-4631-be76-3f6875ade855\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be14f3a-2f04-4d41-b175-edfb0104bbf8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de33c259-1c4d-4631-be76-3f6875ade855 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 (non-flash)
Aug 16 18:24:26 user nova-compute[72000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de33c259-1c4d-4631-be76-3f6875ade855 (non-flash)
Aug 16 18:24:26 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 (non-flash)
Aug 16 18:24:26 user nova-compute[72000]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de33c259-1c4d-4631-be76-3f6875ade855 (non-flash)
Aug 16 18:24:26 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01138bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a191282d-b96b-4111-97e7-1c9defeb4c5c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e174b9e6-9807-42e4-aa4d-a6779831c406]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d01500-c17a-4678-95dd-07d058bc42fc]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af2f5e7-9e62-40f4-b023-33bfbf67fffd]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d003545-6e0f-45a6-b9ad-2f4512fd1aad]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e63845f-afa7-41aa-8e09-86e7b733dbbf]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557, portal: 172.16.0.220,3260]
Aug 16 18:24:27 user nova-compute[72000]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557, portal: 172.16.0.220,3260] successful.
Aug 16 18:24:27 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5cdb258-56de-429d-a561-2e1a8994a557 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[249ba7a3-3a65-482d-9f40-a03ca7fe7478]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] <== disconnect_volume: return (297ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:24:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:24:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:24:30 user nova-compute[72000]: DEBUG nova.objects.instance [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'flavor' on Instance uuid 5849da70-0ea4-4ddb-b333-874e98527b6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:24:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dc9a7e24-f4a3-438a-b3c7-a33cb765a82a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.228s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:24:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:24:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:24:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:24:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:24:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:24:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Updating instance_info_cache with network_info: [{"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:24:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-5849da70-0ea4-4ddb-b333-874e98527b6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:24:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:24:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:24:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:24:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:24:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:24:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:24:34 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:24:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:35 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:24:35 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:24:35 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8435MB free_disk=23.71027374267578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 5849da70-0ea4-4ddb-b333-874e98527b6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:24:35 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:24:36 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:24:36 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:24:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:24:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:24:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "a18d4e32-c275-4c65-a9b7-25f32f43c378" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:24:40 user nova-compute[72000]: INFO nova.compute.claims [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Claim successful on node user
Aug 16 18:24:40 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:24:40 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:24:40 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:24:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:24:40 user nova-compute[72000]: INFO nova.virt.block_device [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Booting with volume fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 at /dev/vda
Aug 16 18:24:41 user nova-compute[72000]: DEBUG nova.policy [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1107151852b84f3185157fff0c0f3495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b758c455ec774042967fb617787c1cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG os_brick.utils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a16bfa-a11c-4ac6-af3d-6bff6b71baf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cb2ba2-cb33-431b-8b87-db141e1c6daa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6fa05d-7915-486f-989a-1c7bc45a2976]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ebcfa-9b56-4a12-b038-d00d773b1e5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:24:41 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:24:41 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7619ecf7-c64f-488e-bbc4-56dc48fd0d3b]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG os_brick.utils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Updating existing volume attachment record: 452e8779-a982-4c72-bdac-57ff0d1dd9aa {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:24:41 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Successfully created port: f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:24:42 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Successfully updated port: f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:24:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:24:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquired lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:24:42 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:24:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-36d7045a-e2bc-41b9-9724-25077b7b6fed req-92ba85f3-5af5-40a3-8d99-c94451b06c30 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received event network-changed-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:24:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-36d7045a-e2bc-41b9-9724-25077b7b6fed req-92ba85f3-5af5-40a3-8d99-c94451b06c30 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Refreshing instance network info cache due to event network-changed-f1b1745c-ee66-4fcf-a2e3-864d5eb34407. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:24:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36d7045a-e2bc-41b9-9724-25077b7b6fed req-92ba85f3-5af5-40a3-8d99-c94451b06c30 service nova] Acquiring lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:24:42 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:24:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:43 user nova-compute[72000]: DEBUG nova.network.neutron [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Updating instance_info_cache with network_info: [{"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:24:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Releasing lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:24:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Instance network_info: |[{"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:24:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36d7045a-e2bc-41b9-9724-25077b7b6fed req-92ba85f3-5af5-40a3-8d99-c94451b06c30 service nova] Acquired lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:24:43 user nova-compute[72000]: DEBUG nova.network.neutron [req-36d7045a-e2bc-41b9-9724-25077b7b6fed req-92ba85f3-5af5-40a3-8d99-c94451b06c30 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Refreshing network info cache for port f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:24:43 user nova-compute[72000]: DEBUG nova.network.neutron [req-36d7045a-e2bc-41b9-9724-25077b7b6fed req-92ba85f3-5af5-40a3-8d99-c94451b06c30 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Updated VIF entry in instance network info cache for port f1b1745c-ee66-4fcf-a2e3-864d5eb34407. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:24:43 user nova-compute[72000]: DEBUG nova.network.neutron [req-36d7045a-e2bc-41b9-9724-25077b7b6fed req-92ba85f3-5af5-40a3-8d99-c94451b06c30 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Updating instance_info_cache with network_info: [{"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:24:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-36d7045a-e2bc-41b9-9724-25077b7b6fed req-92ba85f3-5af5-40a3-8d99-c94451b06c30 service nova] Releasing lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:24:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:24:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:58 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:24:58 user nova-compute[72000]: INFO nova.compute.claims [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Claim successful on node user
Aug 16 18:24:58 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:24:58 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:24:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:24:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG nova.policy [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16c57230dd674d569c5e30b506575633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c9ba43f2dd74a6eab97ebda18fd3616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:24:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Creating image(s)
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "/opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "/opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "/opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk 1073741824" returned: 0 in 0.156s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:24:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.217s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:25:00 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Creating image(s)
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Ensure instance console log exists: /opt/stack/data/nova/instances/a18d4e32-c275-4c65-a9b7-25f32f43c378/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Start _get_guest_xml network_info=[{"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIbDLZTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a18d4e32-c275-4c65-a9b7-25f32f43c378', 'attached_at': '', 'detached_at': '', 'volume_id': 'fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78', 'serial': 'fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78'}, 'attachment_id': '452e8779-a982-4c72-bdac-57ff0d1dd9aa', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:25:00 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:25:00 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIbDLZTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:25:00 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:25:00 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:25:00 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Successfully created port: 11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Cannot resize image /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.objects.instance [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'migration_context' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[077dcfbb-6dfd-4131-bf0e-52cf4622b3ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:25:00 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Ensure instance console log exists: /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[63047372-ec47-472d-a8fe-cc5618121755]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78] added
Aug 16 18:25:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11e0ca2-a748-4704-9907-f100d73a244c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[74525dd1-a1c2-4ca2-a618-cc7417b24d06]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIbDLZTm {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIbDLZTm" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a1136c-f2e3-4733-a316-e0c6d3184a83]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIbDLZTm'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[790ee62f-f5db-4cee-9745-273c9a867e7c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8408704-8f4c-4ed7-b2ba-ca4547f3b287]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:25:00 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:25:00 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:25:00 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 18:25:00 user nova-compute[72000]: 
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[94901f5a-f775-45f8-9359-3f3d697f8c3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78, portal: 172.16.0.220,3260]
Aug 16 18:25:00 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78, portal: 172.16.0.220,3260] successful.
Aug 16 18:25:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cb0c5d-982f-4437-a9cf-f76f3248a930]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc295c5-6d69-4f49-a104-b594e5bc8cd2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:25:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:25:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff0a1f5-bea2-4966-afb8-fbaf2d5d5e4d]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:25:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIbDLZTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Successfully updated port: 11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquired lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-792bc09d-d528-4d55-9f81-0ed630b686d6 req-4f3513d1-ae2a-4b7d-9ae5-6382469316be service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received event network-changed-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-792bc09d-d528-4d55-9f81-0ed630b686d6 req-4f3513d1-ae2a-4b7d-9ae5-6382469316be service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Refreshing instance network info cache due to event network-changed-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-792bc09d-d528-4d55-9f81-0ed630b686d6 req-4f3513d1-ae2a-4b7d-9ae5-6382469316be service nova] Acquiring lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating instance_info_cache with network_info: [{"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Releasing lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Instance network_info: |[{"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-792bc09d-d528-4d55-9f81-0ed630b686d6 req-4f3513d1-ae2a-4b7d-9ae5-6382469316be service nova] Acquired lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.neutron [req-792bc09d-d528-4d55-9f81-0ed630b686d6 req-4f3513d1-ae2a-4b7d-9ae5-6382469316be service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Refreshing network info cache for port 11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Start _get_guest_xml network_info=[{"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23939653238636165', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939653238636165', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:25:01 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:25:01 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1960269605',display_name='tempest-SnapshotDataIntegrityTests-server-1960269605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1960269605',id=37,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLJbgfhmL0on4Sy4w9JPSiSensAVu4PJViUTj/8IVG5lTBZ32G2crp6bfrmhc2IAEtAugj86ApPqmN7WiNwm7XaDa2X0kLSP3/1eYn1J87d+6edFGlUrLwzHGQ3QTCOoQ==',key_name='tempest-keypair-765710998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c9ba43f2dd74a6eab97ebda18fd3616',ramdisk_id='',reservation_id='r-jda144uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-138910526',owner_user_name='tempest-SnapshotDataIntegrityTests-138910526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:24:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16c57230dd674d569c5e30b506575633',uuid=42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Converting VIF {"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:98:bd,bridge_name='br-int',has_traffic_filtering=True,id=11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628,network=Network(320b78ef-65a7-4649-b023-5dc2131c81bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e34bbc-d4') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.objects.instance [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'pci_devices' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-230507419',display_name='tempest-TestVolumeBootPattern-volume-backed-server-230507419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-230507419',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXTO0qOY74shzu6C+T3RvxTkCtJ5En7miZfG/lOvyxidaTF6h3oN3q9+nDlUiVbfF7B3q8ZTdfUnpFFa+sE3bhQ8Js4cyd3Fw9t1eAfNyvjLVYAAnzNbWE8JPXGlRiVhA==',key_name='tempest-keypair-1388305890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-0ff4x1e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:24:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1107151852b84f3185157fff0c0f3495',uuid=a18d4e32-c275-4c65-a9b7-25f32f43c378,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9b:c6,bridge_name='br-int',has_traffic_filtering=True,id=f1b1745c-ee66-4fcf-a2e3-864d5eb34407,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b1745c-ee') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.objects.instance [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'pci_devices' on Instance uuid a18d4e32-c275-4c65-a9b7-25f32f43c378 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:25:01 user nova-compute[72000]:   <uuid>42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9</uuid>
Aug 16 18:25:01 user nova-compute[72000]:   <name>instance-00000025</name>
Aug 16 18:25:01 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:25:01 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:25:01 user nova-compute[72000]:   <metadata>
Aug 16 18:25:01 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:25:01 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1960269605</nova:name>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:25:01</nova:creationTime>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:25:01 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:25:01 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:owner>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:user uuid="16c57230dd674d569c5e30b506575633">tempest-SnapshotDataIntegrityTests-138910526-project-member</nova:user>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:project uuid="6c9ba43f2dd74a6eab97ebda18fd3616">tempest-SnapshotDataIntegrityTests-138910526</nova:project>
Aug 16 18:25:01 user nova-compute[72000]:       </nova:owner>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:ports>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:port uuid="11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628">
Aug 16 18:25:01 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 18:25:01 user nova-compute[72000]:         </nova:port>
Aug 16 18:25:01 user nova-compute[72000]:       </nova:ports>
Aug 16 18:25:01 user nova-compute[72000]:     </nova:instance>
Aug 16 18:25:01 user nova-compute[72000]:   </metadata>
Aug 16 18:25:01 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:25:01 user nova-compute[72000]:     <system>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="serial">42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9</entry>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="uuid">42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9</entry>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:25:01 user nova-compute[72000]:     </system>
Aug 16 18:25:01 user nova-compute[72000]:   </sysinfo>
Aug 16 18:25:01 user nova-compute[72000]:   <os>
Aug 16 18:25:01 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:25:01 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:25:01 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:25:01 user nova-compute[72000]:   </os>
Aug 16 18:25:01 user nova-compute[72000]:   <features>
Aug 16 18:25:01 user nova-compute[72000]:     <acpi/>
Aug 16 18:25:01 user nova-compute[72000]:     <apic/>
Aug 16 18:25:01 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:25:01 user nova-compute[72000]:   </features>
Aug 16 18:25:01 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:25:01 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:25:01 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:25:01 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:25:01 user nova-compute[72000]:   </clock>
Aug 16 18:25:01 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:25:01 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:25:01 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:25:01 user nova-compute[72000]:   </cpu>
Aug 16 18:25:01 user nova-compute[72000]:   <devices>
Aug 16 18:25:01 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:25:01 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:25:01 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk"/>
Aug 16 18:25:01 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:25:01 user nova-compute[72000]:     </disk>
Aug 16 18:25:01 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:25:01 user nova-compute[72000]:       <mac address="fa:16:3e:b9:98:bd"/>
Aug 16 18:25:01 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:25:01 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:25:01 user nova-compute[72000]:       <target dev="tap11e34bbc-d4"/>
Aug 16 18:25:01 user nova-compute[72000]:     </interface>
Aug 16 18:25:01 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:25:01 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/console.log" append="off"/>
Aug 16 18:25:01 user nova-compute[72000]:     </serial>
Aug 16 18:25:01 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:25:01 user nova-compute[72000]:     <video>
Aug 16 18:25:01 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:25:01 user nova-compute[72000]:     </video>
Aug 16 18:25:01 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:25:01 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:25:01 user nova-compute[72000]:     </rng>
Aug 16 18:25:01 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:25:01 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:25:01 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:25:01 user nova-compute[72000]:     </memballoon>
Aug 16 18:25:01 user nova-compute[72000]:   </devices>
Aug 16 18:25:01 user nova-compute[72000]: </domain>
Aug 16 18:25:01 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1960269605',display_name='tempest-SnapshotDataIntegrityTests-server-1960269605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1960269605',id=37,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLJbgfhmL0on4Sy4w9JPSiSensAVu4PJViUTj/8IVG5lTBZ32G2crp6bfrmhc2IAEtAugj86ApPqmN7WiNwm7XaDa2X0kLSP3/1eYn1J87d+6edFGlUrLwzHGQ3QTCOoQ==',key_name='tempest-keypair-765710998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c9ba43f2dd74a6eab97ebda18fd3616',ramdisk_id='',reservation_id='r-jda144uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-138910526',owner_user_name='tempest-SnapshotDataIntegrityTests-138910526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:24:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16c57230dd674d569c5e30b506575633',uuid=42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Converting VIF {"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:98:bd,bridge_name='br-int',has_traffic_filtering=True,id=11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628,network=Network(320b78ef-65a7-4649-b023-5dc2131c81bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e34bbc-d4') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG os_vif [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:98:bd,bridge_name='br-int',has_traffic_filtering=True,id=11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628,network=Network(320b78ef-65a7-4649-b023-5dc2131c81bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e34bbc-d4') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:25:01 user nova-compute[72000]:   <uuid>a18d4e32-c275-4c65-a9b7-25f32f43c378</uuid>
Aug 16 18:25:01 user nova-compute[72000]:   <name>instance-00000024</name>
Aug 16 18:25:01 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:25:01 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:25:01 user nova-compute[72000]:   <metadata>
Aug 16 18:25:01 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:25:01 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-230507419</nova:name>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:25:00</nova:creationTime>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:25:01 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:25:01 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:owner>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:user uuid="1107151852b84f3185157fff0c0f3495">tempest-TestVolumeBootPattern-109968882-project-member</nova:user>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:project uuid="b758c455ec774042967fb617787c1cbd">tempest-TestVolumeBootPattern-109968882</nova:project>
Aug 16 18:25:01 user nova-compute[72000]:       </nova:owner>
Aug 16 18:25:01 user nova-compute[72000]:       <nova:ports>
Aug 16 18:25:01 user nova-compute[72000]:         <nova:port uuid="f1b1745c-ee66-4fcf-a2e3-864d5eb34407">
Aug 16 18:25:01 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 16 18:25:01 user nova-compute[72000]:         </nova:port>
Aug 16 18:25:01 user nova-compute[72000]:       </nova:ports>
Aug 16 18:25:01 user nova-compute[72000]:     </nova:instance>
Aug 16 18:25:01 user nova-compute[72000]:   </metadata>
Aug 16 18:25:01 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:25:01 user nova-compute[72000]:     <system>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="serial">a18d4e32-c275-4c65-a9b7-25f32f43c378</entry>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="uuid">a18d4e32-c275-4c65-a9b7-25f32f43c378</entry>
Aug 16 18:25:01 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:25:01 user nova-compute[72000]:     </system>
Aug 16 18:25:01 user nova-compute[72000]:   </sysinfo>
Aug 16 18:25:01 user nova-compute[72000]:   <os>
Aug 16 18:25:01 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:25:01 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:25:01 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:25:01 user nova-compute[72000]:   </os>
Aug 16 18:25:01 user nova-compute[72000]:   <features>
Aug 16 18:25:01 user nova-compute[72000]:     <acpi/>
Aug 16 18:25:01 user nova-compute[72000]:     <apic/>
Aug 16 18:25:01 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:25:01 user nova-compute[72000]:   </features>
Aug 16 18:25:01 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:25:01 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:25:01 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:25:01 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:25:01 user nova-compute[72000]:   </clock>
Aug 16 18:25:01 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:25:01 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:25:01 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:25:01 user nova-compute[72000]:   </cpu>
Aug 16 18:25:01 user nova-compute[72000]:   <devices>
Aug 16 18:25:01 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:25:01 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:25:01 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 18:25:01 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:25:01 user nova-compute[72000]:       <serial>fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78</serial>
Aug 16 18:25:01 user nova-compute[72000]:     </disk>
Aug 16 18:25:01 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:25:01 user nova-compute[72000]:       <mac address="fa:16:3e:e0:9b:c6"/>
Aug 16 18:25:01 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:25:01 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:25:01 user nova-compute[72000]:       <target dev="tapf1b1745c-ee"/>
Aug 16 18:25:01 user nova-compute[72000]:     </interface>
Aug 16 18:25:01 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:25:01 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/a18d4e32-c275-4c65-a9b7-25f32f43c378/console.log" append="off"/>
Aug 16 18:25:01 user nova-compute[72000]:     </serial>
Aug 16 18:25:01 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:25:01 user nova-compute[72000]:     <video>
Aug 16 18:25:01 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:25:01 user nova-compute[72000]:     </video>
Aug 16 18:25:01 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:25:01 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:25:01 user nova-compute[72000]:     </rng>
Aug 16 18:25:01 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:25:01 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:25:01 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:25:01 user nova-compute[72000]:     </memballoon>
Aug 16 18:25:01 user nova-compute[72000]:   </devices>
Aug 16 18:25:01 user nova-compute[72000]: </domain>
Aug 16 18:25:01 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-230507419',display_name='tempest-TestVolumeBootPattern-volume-backed-server-230507419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-230507419',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXTO0qOY74shzu6C+T3RvxTkCtJ5En7miZfG/lOvyxidaTF6h3oN3q9+nDlUiVbfF7B3q8ZTdfUnpFFa+sE3bhQ8Js4cyd3Fw9t1eAfNyvjLVYAAnzNbWE8JPXGlRiVhA==',key_name='tempest-keypair-1388305890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-0ff4x1e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:24:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1107151852b84f3185157fff0c0f3495',uuid=a18d4e32-c275-4c65-a9b7-25f32f43c378,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9b:c6,bridge_name='br-int',has_traffic_filtering=True,id=f1b1745c-ee66-4fcf-a2e3-864d5eb34407,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b1745c-ee') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG os_vif [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9b:c6,bridge_name='br-int',has_traffic_filtering=True,id=f1b1745c-ee66-4fcf-a2e3-864d5eb34407,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b1745c-ee') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11e34bbc-d4, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11e34bbc-d4, col_values=(('external_ids', {'iface-id': '11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:98:bd', 'vm-uuid': '42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:01 user nova-compute[72000]: INFO os_vif [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:98:bd,bridge_name='br-int',has_traffic_filtering=True,id=11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628,network=Network(320b78ef-65a7-4649-b023-5dc2131c81bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e34bbc-d4')
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1b1745c-ee, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1b1745c-ee, col_values=(('external_ids', {'iface-id': 'f1b1745c-ee66-4fcf-a2e3-864d5eb34407', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:9b:c6', 'vm-uuid': 'a18d4e32-c275-4c65-a9b7-25f32f43c378'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:01 user nova-compute[72000]: INFO os_vif [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:9b:c6,bridge_name='br-int',has_traffic_filtering=True,id=f1b1745c-ee66-4fcf-a2e3-864d5eb34407,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b1745c-ee')
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No VIF found with MAC fa:16:3e:b9:98:bd, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No VIF found with MAC fa:16:3e:e0:9b:c6, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.neutron [req-792bc09d-d528-4d55-9f81-0ed630b686d6 req-4f3513d1-ae2a-4b7d-9ae5-6382469316be service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updated VIF entry in instance network info cache for port 11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG nova.network.neutron [req-792bc09d-d528-4d55-9f81-0ed630b686d6 req-4f3513d1-ae2a-4b7d-9ae5-6382469316be service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating instance_info_cache with network_info: [{"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:25:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-792bc09d-d528-4d55-9f81-0ed630b686d6 req-4f3513d1-ae2a-4b7d-9ae5-6382469316be service nova] Releasing lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:25:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-8236a35e-f36d-4174-ac6d-fce32859468e req-34b67182-90d6-4983-bdf6-ce72b1925650 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received event network-vif-plugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8236a35e-f36d-4174-ac6d-fce32859468e req-34b67182-90d6-4983-bdf6-ce72b1925650 service nova] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8236a35e-f36d-4174-ac6d-fce32859468e req-34b67182-90d6-4983-bdf6-ce72b1925650 service nova] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8236a35e-f36d-4174-ac6d-fce32859468e req-34b67182-90d6-4983-bdf6-ce72b1925650 service nova] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-8236a35e-f36d-4174-ac6d-fce32859468e req-34b67182-90d6-4983-bdf6-ce72b1925650 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] No waiting events found dispatching network-vif-plugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:25:04 user nova-compute[72000]: WARNING nova.compute.manager [req-8236a35e-f36d-4174-ac6d-fce32859468e req-34b67182-90d6-4983-bdf6-ce72b1925650 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received unexpected event network-vif-plugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 for instance with vm_state building and task_state spawning.
Aug 16 18:25:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received event network-vif-plugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] No waiting events found dispatching network-vif-plugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:25:06 user nova-compute[72000]: WARNING nova.compute.manager [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received unexpected event network-vif-plugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 for instance with vm_state building and task_state spawning.
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received event network-vif-plugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] Acquiring lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] No waiting events found dispatching network-vif-plugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:25:06 user nova-compute[72000]: WARNING nova.compute.manager [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received unexpected event network-vif-plugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 for instance with vm_state building and task_state spawning.
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received event network-vif-plugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] Acquiring lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] No waiting events found dispatching network-vif-plugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:25:06 user nova-compute[72000]: WARNING nova.compute.manager [req-42f71b3b-21bb-4c8b-8923-ada5c345e9fb req-66e161f5-355c-464d-bbeb-f2d8fee59e5f service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received unexpected event network-vif-plugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 for instance with vm_state building and task_state spawning.
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210306.8790212, a18d4e32-c275-4c65-a9b7-25f32f43c378 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:25:06 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] VM Resumed (Lifecycle Event)
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:25:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Instance spawned successfully.
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:25:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Instance spawned successfully.
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210306.8812237, a18d4e32-c275-4c65-a9b7-25f32f43c378 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:25:06 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] VM Started (Lifecycle Event)
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:25:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:25:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:25:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210306.9074192, 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:25:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] VM Resumed (Lifecycle Event)
Aug 16 18:25:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:25:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:25:07 user nova-compute[72000]: INFO nova.compute.manager [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Took 7.82 seconds to spawn the instance on the hypervisor.
Aug 16 18:25:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:25:07 user nova-compute[72000]: INFO nova.compute.manager [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Took 6.93 seconds to spawn the instance on the hypervisor.
Aug 16 18:25:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:25:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:25:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210306.90892, 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:25:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] VM Started (Lifecycle Event)
Aug 16 18:25:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:25:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:25:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:25:07 user nova-compute[72000]: INFO nova.compute.manager [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Took 8.42 seconds to build instance.
Aug 16 18:25:07 user nova-compute[72000]: INFO nova.compute.manager [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Took 26.77 seconds to build instance.
Aug 16 18:25:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-27d85450-901b-42b8-8b27-e313f6f6cb41 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.528s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1adead53-e768-413f-9dc7-63e2b90660a5 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.878s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "5849da70-0ea4-4ddb-b333-874e98527b6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:17 user nova-compute[72000]: INFO nova.compute.manager [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Terminating instance
Aug 16 18:25:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG nova.compute.manager [req-a3f16c5e-2894-48b6-8b3a-16565d94360f req-37bd030d-258b-4265-82d7-d4dfc9cff02d service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received event network-vif-unplugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a3f16c5e-2894-48b6-8b3a-16565d94360f req-37bd030d-258b-4265-82d7-d4dfc9cff02d service nova] Acquiring lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a3f16c5e-2894-48b6-8b3a-16565d94360f req-37bd030d-258b-4265-82d7-d4dfc9cff02d service nova] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a3f16c5e-2894-48b6-8b3a-16565d94360f req-37bd030d-258b-4265-82d7-d4dfc9cff02d service nova] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG nova.compute.manager [req-a3f16c5e-2894-48b6-8b3a-16565d94360f req-37bd030d-258b-4265-82d7-d4dfc9cff02d service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] No waiting events found dispatching network-vif-unplugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:25:17 user nova-compute[72000]: DEBUG nova.compute.manager [req-a3f16c5e-2894-48b6-8b3a-16565d94360f req-37bd030d-258b-4265-82d7-d4dfc9cff02d service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received event network-vif-unplugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:25:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Instance destroyed successfully.
Aug 16 18:25:18 user nova-compute[72000]: DEBUG nova.objects.instance [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'resources' on Instance uuid 5849da70-0ea4-4ddb-b333-874e98527b6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:25:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2000231875',display_name='tempest-AttachVolumeNegativeTest-server-2000231875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2000231875',id=35,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgV+svyxNjDLZpfWHC4uREbcgJ6RT9x19MlM0IcmTMRt51EDSbr9NoHgLsI4/uPC31jaF94v+CVvXnIs89AFZBXZFzW46es2mP02NaMt0vK6wiEdYtoK/AGR7uPX7lmjA==',key_name='tempest-keypair-929221982',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-jbk3g4vg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=5849da70-0ea4-4ddb-b333-874e98527b6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:25:18 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "address": "fa:16:3e:c5:9f:18", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a2c5b0f-52", "ovs_interfaceid": "6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:25:18 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a2c5b0f-52') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:25:18 user nova-compute[72000]: DEBUG os_vif [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a2c5b0f-52') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:25:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a2c5b0f-52, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:25:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:25:18 user nova-compute[72000]: INFO os_vif [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a2c5b0f-52')
Aug 16 18:25:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Deleting instance files /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d_del
Aug 16 18:25:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Deletion of /opt/stack/data/nova/instances/5849da70-0ea4-4ddb-b333-874e98527b6d_del complete
Aug 16 18:25:18 user nova-compute[72000]: INFO nova.compute.manager [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 16 18:25:18 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:25:18 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:25:18 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-0bcde1bb-49e9-4421-b485-de2f6e88007a req-8766fafb-040e-4c7e-adf8-3cb5dc955639 service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received event network-vif-deleted-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:25:19 user nova-compute[72000]: INFO nova.compute.manager [req-0bcde1bb-49e9-4421-b485-de2f6e88007a req-8766fafb-040e-4c7e-adf8-3cb5dc955639 service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Neutron deleted interface 6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe; detaching it from the instance and deleting it from the info cache
Aug 16 18:25:19 user nova-compute[72000]: DEBUG nova.network.neutron [req-0bcde1bb-49e9-4421-b485-de2f6e88007a req-8766fafb-040e-4c7e-adf8-3cb5dc955639 service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:25:19 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Took 0.79 seconds to deallocate network for instance.
Aug 16 18:25:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-0bcde1bb-49e9-4421-b485-de2f6e88007a req-8766fafb-040e-4c7e-adf8-3cb5dc955639 service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Detach interface failed, port_id=6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe, reason: Instance 5849da70-0ea4-4ddb-b333-874e98527b6d could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:19 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Deleted allocations for instance 5849da70-0ea4-4ddb-b333-874e98527b6d
Aug 16 18:25:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b0bcd39b-6535-45ce-a1e6-6996970aab3a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.156s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-7bb65eb1-3243-48d0-9f52-f1b129dd9d65 req-b2115184-4903-4479-b253-2f5419e3276e service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received event network-vif-plugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7bb65eb1-3243-48d0-9f52-f1b129dd9d65 req-b2115184-4903-4479-b253-2f5419e3276e service nova] Acquiring lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7bb65eb1-3243-48d0-9f52-f1b129dd9d65 req-b2115184-4903-4479-b253-2f5419e3276e service nova] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7bb65eb1-3243-48d0-9f52-f1b129dd9d65 req-b2115184-4903-4479-b253-2f5419e3276e service nova] Lock "5849da70-0ea4-4ddb-b333-874e98527b6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-7bb65eb1-3243-48d0-9f52-f1b129dd9d65 req-b2115184-4903-4479-b253-2f5419e3276e service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] No waiting events found dispatching network-vif-plugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:25:19 user nova-compute[72000]: WARNING nova.compute.manager [req-7bb65eb1-3243-48d0-9f52-f1b129dd9d65 req-b2115184-4903-4479-b253-2f5419e3276e service nova] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Received unexpected event network-vif-plugged-6a2c5b0f-52ad-44b7-90b5-7ddbe7ecc2fe for instance with vm_state deleted and task_state None.
Aug 16 18:25:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "cef1b726-614c-4b75-8b44-5bc62f235424-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:24 user nova-compute[72000]: INFO nova.compute.manager [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Terminating instance
Aug 16 18:25:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [-] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] During wait destroy, instance disappeared. {{(pid=72000) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1517}}
Aug 16 18:25:24 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Instance destroyed successfully.
Aug 16 18:25:24 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'resources' on Instance uuid cef1b726-614c-4b75-8b44-5bc62f235424 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-16T18:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-291985954',display_name='tempest-ServerActionsTestOtherA-server-1287166797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-291985954',id=12,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFUjGaHE7pKkphpIlu+qb5TThvRrvfTMXIg6LvDq93nPXqpmsinbGBzE/z1sLW3pAtQ4HaRizKrUDwqgopKDrCUOR6hQe9eKG4sjH3iE9tGInsfqp0+BxDMbd8d9L+pnQ==',key_name='tempest-keypair-1405337443',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-r1k21jr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=cef1b726-614c-4b75-8b44-5bc62f235424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "address": "fa:16:3e:77:34:1d", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4c186b-25", "ovs_interfaceid": "0f4c186b-25e4-4a47-a54e-d58d0abf66fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f4c186b-25e4-4a47-a54e-d58d0abf66fa,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4c186b-25') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_vif [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f4c186b-25e4-4a47-a54e-d58d0abf66fa,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4c186b-25') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f4c186b-25, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:25:24 user nova-compute[72000]: INFO os_vif [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:34:1d,bridge_name='br-int',has_traffic_filtering=True,id=0f4c186b-25e4-4a47-a54e-d58d0abf66fa,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4c186b-25')
Aug 16 18:25:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOiDNCLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:25:24 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee7f526-7ef4-4562-83e5-567b5edf70f6', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2979e8-8975-4e9c-9dc6-4cbd9962883a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cd1be5-49b5-4745-a863-bd242b43d691]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:25:24 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:25:24 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd011398ca0>, {}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Disconnecting from: [] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== disconnect_volume: return (46ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:25:24 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Deletion of /opt/stack/data/nova/instances/cef1b726-614c-4b75-8b44-5bc62f235424_del complete
Aug 16 18:25:24 user nova-compute[72000]: INFO nova.compute.manager [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Took 0.13 seconds to destroy the instance on the hypervisor.
Aug 16 18:25:24 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:25:24 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:25:25 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:25:25 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Took 0.94 seconds to deallocate network for instance.
Aug 16 18:25:25 user nova-compute[72000]: DEBUG nova.compute.manager [req-739ac6d3-25b3-4f16-8548-38b226c42d0d req-60e5a5eb-e9fe-4532-8ed1-5ad04c978f7e service nova] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Received event network-vif-deleted-0f4c186b-25e4-4a47-a54e-d58d0abf66fa {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:25:25 user nova-compute[72000]: INFO nova.compute.manager [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: cef1b726-614c-4b75-8b44-5bc62f235424] Took 0.07 seconds to detach 1 volumes for instance.
Aug 16 18:25:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:25 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:25:25 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:25:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0f25b86b-6e36-4473-b70e-5a03af6de930 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "cef1b726-614c-4b75-8b44-5bc62f235424" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.494s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:25:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:25:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:25:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:29 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:25:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:25:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:25:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 18:25:33 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210318.1728911, 5849da70-0ea4-4ddb-b333-874e98527b6d => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:25:33 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] VM Stopped (Lifecycle Event)
Aug 16 18:25:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ad3bc05d-0c12-42df-a124-1b15a898f9f5 None None] [instance: 5849da70-0ea4-4ddb-b333-874e98527b6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:25:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:25:36 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:25:36 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:25:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8292MB free_disk=23.68866729736328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a18d4e32-c275-4c65-a9b7-25f32f43c378 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:25:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:25:37 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:25:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:25:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:25:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:25:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:25:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:25:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:25:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:26:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:26:12 user nova-compute[72000]: INFO nova.compute.claims [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Claim successful on node user
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:26:12 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.policy [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfe1063b05894bfeb8f08bc29602b2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b557a84c43a47db90c0eb7054a77446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:26:12 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Creating image(s)
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "/opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "/opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk 1073741824" returned: 0 in 0.051s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.170s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Successfully created port: 61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Cannot resize image /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG nova.objects.instance [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'migration_context' on Instance uuid 6fccbca3-d0de-4797-8adc-63c1cc470b3d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Ensure instance console log exists: /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:14 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Successfully updated port: 61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:26:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "refresh_cache-6fccbca3-d0de-4797-8adc-63c1cc470b3d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:26:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquired lock "refresh_cache-6fccbca3-d0de-4797-8adc-63c1cc470b3d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:26:14 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:26:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-5bd91475-3185-4adf-b122-28d979f34be4 req-26c18487-3f6a-417f-a27d-084e08ffeeb0 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received event network-changed-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:26:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-5bd91475-3185-4adf-b122-28d979f34be4 req-26c18487-3f6a-417f-a27d-084e08ffeeb0 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Refreshing instance network info cache due to event network-changed-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:26:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5bd91475-3185-4adf-b122-28d979f34be4 req-26c18487-3f6a-417f-a27d-084e08ffeeb0 service nova] Acquiring lock "refresh_cache-6fccbca3-d0de-4797-8adc-63c1cc470b3d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:26:14 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Updating instance_info_cache with network_info: [{"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Releasing lock "refresh_cache-6fccbca3-d0de-4797-8adc-63c1cc470b3d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Instance network_info: |[{"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5bd91475-3185-4adf-b122-28d979f34be4 req-26c18487-3f6a-417f-a27d-084e08ffeeb0 service nova] Acquired lock "refresh_cache-6fccbca3-d0de-4797-8adc-63c1cc470b3d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.network.neutron [req-5bd91475-3185-4adf-b122-28d979f34be4 req-26c18487-3f6a-417f-a27d-084e08ffeeb0 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Refreshing network info cache for port 61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Start _get_guest_xml network_info=[{"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:26:15 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:26:15 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-914338646',display_name='tempest-AttachVolumeNegativeTest-server-914338646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-914338646',id=38,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSUUu6TbotiCr7HelZ17bK4ZsnYO7UrrNeJEEOjvYhjk3BUjET9cqJkBhaxwQFAXgKQ9rvZkXHFver0rY0M86S1pAzxlHf95KReoqaEqnLQ460J5dJ/zMDz1tWmJrGlBA==',key_name='tempest-keypair-1196747055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-hng4zuky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=6fccbca3-d0de-4797-8adc-63c1cc470b3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dd:0d,bridge_name='br-int',has_traffic_filtering=True,id=61f59e1e-952e-4d43-9d5b-ec3734ba4d5c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61f59e1e-95') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.objects.instance [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fccbca3-d0de-4797-8adc-63c1cc470b3d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:26:15 user nova-compute[72000]:   <uuid>6fccbca3-d0de-4797-8adc-63c1cc470b3d</uuid>
Aug 16 18:26:15 user nova-compute[72000]:   <name>instance-00000026</name>
Aug 16 18:26:15 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:26:15 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:26:15 user nova-compute[72000]:   <metadata>
Aug 16 18:26:15 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:26:15 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:26:15 user nova-compute[72000]:       <nova:name>tempest-AttachVolumeNegativeTest-server-914338646</nova:name>
Aug 16 18:26:15 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:26:15</nova:creationTime>
Aug 16 18:26:15 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:26:15 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:26:15 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:26:15 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:26:15 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:26:15 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:26:15 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:26:15 user nova-compute[72000]:       <nova:owner>
Aug 16 18:26:15 user nova-compute[72000]:         <nova:user uuid="cfe1063b05894bfeb8f08bc29602b2fa">tempest-AttachVolumeNegativeTest-678349136-project-member</nova:user>
Aug 16 18:26:15 user nova-compute[72000]:         <nova:project uuid="9b557a84c43a47db90c0eb7054a77446">tempest-AttachVolumeNegativeTest-678349136</nova:project>
Aug 16 18:26:15 user nova-compute[72000]:       </nova:owner>
Aug 16 18:26:15 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:26:15 user nova-compute[72000]:       <nova:ports>
Aug 16 18:26:15 user nova-compute[72000]:         <nova:port uuid="61f59e1e-952e-4d43-9d5b-ec3734ba4d5c">
Aug 16 18:26:15 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 18:26:15 user nova-compute[72000]:         </nova:port>
Aug 16 18:26:15 user nova-compute[72000]:       </nova:ports>
Aug 16 18:26:15 user nova-compute[72000]:     </nova:instance>
Aug 16 18:26:15 user nova-compute[72000]:   </metadata>
Aug 16 18:26:15 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:26:15 user nova-compute[72000]:     <system>
Aug 16 18:26:15 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:26:15 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:26:15 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:26:15 user nova-compute[72000]:       <entry name="serial">6fccbca3-d0de-4797-8adc-63c1cc470b3d</entry>
Aug 16 18:26:15 user nova-compute[72000]:       <entry name="uuid">6fccbca3-d0de-4797-8adc-63c1cc470b3d</entry>
Aug 16 18:26:15 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:26:15 user nova-compute[72000]:     </system>
Aug 16 18:26:15 user nova-compute[72000]:   </sysinfo>
Aug 16 18:26:15 user nova-compute[72000]:   <os>
Aug 16 18:26:15 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:26:15 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:26:15 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:26:15 user nova-compute[72000]:   </os>
Aug 16 18:26:15 user nova-compute[72000]:   <features>
Aug 16 18:26:15 user nova-compute[72000]:     <acpi/>
Aug 16 18:26:15 user nova-compute[72000]:     <apic/>
Aug 16 18:26:15 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:26:15 user nova-compute[72000]:   </features>
Aug 16 18:26:15 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:26:15 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:26:15 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:26:15 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:26:15 user nova-compute[72000]:   </clock>
Aug 16 18:26:15 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:26:15 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:26:15 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:26:15 user nova-compute[72000]:   </cpu>
Aug 16 18:26:15 user nova-compute[72000]:   <devices>
Aug 16 18:26:15 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:26:15 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:26:15 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk"/>
Aug 16 18:26:15 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:26:15 user nova-compute[72000]:     </disk>
Aug 16 18:26:15 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:26:15 user nova-compute[72000]:       <mac address="fa:16:3e:3e:dd:0d"/>
Aug 16 18:26:15 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:26:15 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:26:15 user nova-compute[72000]:       <target dev="tap61f59e1e-95"/>
Aug 16 18:26:15 user nova-compute[72000]:     </interface>
Aug 16 18:26:15 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:26:15 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/console.log" append="off"/>
Aug 16 18:26:15 user nova-compute[72000]:     </serial>
Aug 16 18:26:15 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:26:15 user nova-compute[72000]:     <video>
Aug 16 18:26:15 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:26:15 user nova-compute[72000]:     </video>
Aug 16 18:26:15 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:26:15 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:26:15 user nova-compute[72000]:     </rng>
Aug 16 18:26:15 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:26:15 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:26:15 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:26:15 user nova-compute[72000]:     </memballoon>
Aug 16 18:26:15 user nova-compute[72000]:   </devices>
Aug 16 18:26:15 user nova-compute[72000]: </domain>
Aug 16 18:26:15 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-914338646',display_name='tempest-AttachVolumeNegativeTest-server-914338646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-914338646',id=38,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSUUu6TbotiCr7HelZ17bK4ZsnYO7UrrNeJEEOjvYhjk3BUjET9cqJkBhaxwQFAXgKQ9rvZkXHFver0rY0M86S1pAzxlHf95KReoqaEqnLQ460J5dJ/zMDz1tWmJrGlBA==',key_name='tempest-keypair-1196747055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-hng4zuky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=6fccbca3-d0de-4797-8adc-63c1cc470b3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dd:0d,bridge_name='br-int',has_traffic_filtering=True,id=61f59e1e-952e-4d43-9d5b-ec3734ba4d5c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61f59e1e-95') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG os_vif [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dd:0d,bridge_name='br-int',has_traffic_filtering=True,id=61f59e1e-952e-4d43-9d5b-ec3734ba4d5c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61f59e1e-95') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61f59e1e-95, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61f59e1e-95, col_values=(('external_ids', {'iface-id': '61f59e1e-952e-4d43-9d5b-ec3734ba4d5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:dd:0d', 'vm-uuid': '6fccbca3-d0de-4797-8adc-63c1cc470b3d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:15 user nova-compute[72000]: INFO os_vif [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:dd:0d,bridge_name='br-int',has_traffic_filtering=True,id=61f59e1e-952e-4d43-9d5b-ec3734ba4d5c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61f59e1e-95')
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No VIF found with MAC fa:16:3e:3e:dd:0d, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.network.neutron [req-5bd91475-3185-4adf-b122-28d979f34be4 req-26c18487-3f6a-417f-a27d-084e08ffeeb0 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Updated VIF entry in instance network info cache for port 61f59e1e-952e-4d43-9d5b-ec3734ba4d5c. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG nova.network.neutron [req-5bd91475-3185-4adf-b122-28d979f34be4 req-26c18487-3f6a-417f-a27d-084e08ffeeb0 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Updating instance_info_cache with network_info: [{"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:26:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5bd91475-3185-4adf-b122-28d979f34be4 req-26c18487-3f6a-417f-a27d-084e08ffeeb0 service nova] Releasing lock "refresh_cache-6fccbca3-d0de-4797-8adc-63c1cc470b3d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:26:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-b46db18a-bc4f-465d-a43c-0b00fcda53e9 req-9a5c3eff-b665-4667-916e-b4870ceb01cc service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received event network-vif-plugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:26:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b46db18a-bc4f-465d-a43c-0b00fcda53e9 req-9a5c3eff-b665-4667-916e-b4870ceb01cc service nova] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b46db18a-bc4f-465d-a43c-0b00fcda53e9 req-9a5c3eff-b665-4667-916e-b4870ceb01cc service nova] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b46db18a-bc4f-465d-a43c-0b00fcda53e9 req-9a5c3eff-b665-4667-916e-b4870ceb01cc service nova] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-b46db18a-bc4f-465d-a43c-0b00fcda53e9 req-9a5c3eff-b665-4667-916e-b4870ceb01cc service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] No waiting events found dispatching network-vif-plugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:26:16 user nova-compute[72000]: WARNING nova.compute.manager [req-b46db18a-bc4f-465d-a43c-0b00fcda53e9 req-9a5c3eff-b665-4667-916e-b4870ceb01cc service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received unexpected event network-vif-plugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c for instance with vm_state building and task_state spawning.
Aug 16 18:26:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210378.7640567, 6fccbca3-d0de-4797-8adc-63c1cc470b3d => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:26:18 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] VM Resumed (Lifecycle Event)
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:26:18 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Instance spawned successfully.
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:26:18 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210378.765667, 6fccbca3-d0de-4797-8adc-63c1cc470b3d => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:26:18 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] VM Started (Lifecycle Event)
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:26:18 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:26:18 user nova-compute[72000]: INFO nova.compute.manager [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 16 18:26:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:26:18 user nova-compute[72000]: INFO nova.compute.manager [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Took 6.79 seconds to build instance.
Aug 16 18:26:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d8b51e31-fdc4-48b2-b3ee-0d9f811a475f tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.882s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-f10cf1a0-72dc-4a7b-858f-f2be84089279 req-5ea141c0-55c7-4463-a041-1207ff2186b7 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received event network-vif-plugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:26:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f10cf1a0-72dc-4a7b-858f-f2be84089279 req-5ea141c0-55c7-4463-a041-1207ff2186b7 service nova] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f10cf1a0-72dc-4a7b-858f-f2be84089279 req-5ea141c0-55c7-4463-a041-1207ff2186b7 service nova] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f10cf1a0-72dc-4a7b-858f-f2be84089279 req-5ea141c0-55c7-4463-a041-1207ff2186b7 service nova] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-f10cf1a0-72dc-4a7b-858f-f2be84089279 req-5ea141c0-55c7-4463-a041-1207ff2186b7 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] No waiting events found dispatching network-vif-plugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:26:19 user nova-compute[72000]: WARNING nova.compute.manager [req-f10cf1a0-72dc-4a7b-858f-f2be84089279 req-5ea141c0-55c7-4463-a041-1207ff2186b7 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received unexpected event network-vif-plugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c for instance with vm_state active and task_state None.
Aug 16 18:26:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:25 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:29 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:26:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:26:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:26:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:26:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-b3a99185-a5c6-4302-a2e5-4b0b73ff1886 req-60349730-5bc2-4324-968b-fb0efce53938 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received event network-changed-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:26:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-b3a99185-a5c6-4302-a2e5-4b0b73ff1886 req-60349730-5bc2-4324-968b-fb0efce53938 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Refreshing instance network info cache due to event network-changed-f1b1745c-ee66-4fcf-a2e3-864d5eb34407. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:26:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b3a99185-a5c6-4302-a2e5-4b0b73ff1886 req-60349730-5bc2-4324-968b-fb0efce53938 service nova] Acquiring lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:26:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b3a99185-a5c6-4302-a2e5-4b0b73ff1886 req-60349730-5bc2-4324-968b-fb0efce53938 service nova] Acquired lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:26:31 user nova-compute[72000]: DEBUG nova.network.neutron [req-b3a99185-a5c6-4302-a2e5-4b0b73ff1886 req-60349730-5bc2-4324-968b-fb0efce53938 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Refreshing network info cache for port f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:26:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:31 user nova-compute[72000]: DEBUG nova.network.neutron [req-b3a99185-a5c6-4302-a2e5-4b0b73ff1886 req-60349730-5bc2-4324-968b-fb0efce53938 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Updated VIF entry in instance network info cache for port f1b1745c-ee66-4fcf-a2e3-864d5eb34407. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:26:31 user nova-compute[72000]: DEBUG nova.network.neutron [req-b3a99185-a5c6-4302-a2e5-4b0b73ff1886 req-60349730-5bc2-4324-968b-fb0efce53938 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Updating instance_info_cache with network_info: [{"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:26:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b3a99185-a5c6-4302-a2e5-4b0b73ff1886 req-60349730-5bc2-4324-968b-fb0efce53938 service nova] Releasing lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:26:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:26:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:26:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:26:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:26:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:26:33 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:26:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:26:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:26:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:26:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:35 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:26:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:26:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:37 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:26:37 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8281MB free_disk=23.658187866210938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a18d4e32-c275-4c65-a9b7-25f32f43c378 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6fccbca3-d0de-4797-8adc-63c1cc470b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:26:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.510s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:26:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:26:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:26:43 user nova-compute[72000]: INFO nova.compute.claims [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Claim successful on node user
Aug 16 18:26:43 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:26:43 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:26:43 user nova-compute[72000]: INFO nova.virt.block_device [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Booting with volume snapshot 7f206566-526d-4698-8ec4-40874ba4d1f1 at /dev/vda
Aug 16 18:26:43 user nova-compute[72000]: DEBUG nova.policy [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1107151852b84f3185157fff0c0f3495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b758c455ec774042967fb617787c1cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:26:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:44 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Successfully created port: 57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Successfully updated port: 57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "refresh_cache-fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquired lock "refresh_cache-fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-d453226f-3670-451e-a280-3a2a015ca01a req-50fe462c-35f3-4d6f-8c53-6a495fd1cf17 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received event network-changed-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-d453226f-3670-451e-a280-3a2a015ca01a req-50fe462c-35f3-4d6f-8c53-6a495fd1cf17 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Refreshing instance network info cache due to event network-changed-57d28229-6c45-40b7-8947-c2e3f1589ba5. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d453226f-3670-451e-a280-3a2a015ca01a req-50fe462c-35f3-4d6f-8c53-6a495fd1cf17 service nova] Acquiring lock "refresh_cache-fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Updating instance_info_cache with network_info: [{"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Releasing lock "refresh_cache-fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Instance network_info: |[{"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d453226f-3670-451e-a280-3a2a015ca01a req-50fe462c-35f3-4d6f-8c53-6a495fd1cf17 service nova] Acquired lock "refresh_cache-fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:26:45 user nova-compute[72000]: DEBUG nova.network.neutron [req-d453226f-3670-451e-a280-3a2a015ca01a req-50fe462c-35f3-4d6f-8c53-6a495fd1cf17 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Refreshing network info cache for port 57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:26:46 user nova-compute[72000]: DEBUG nova.network.neutron [req-d453226f-3670-451e-a280-3a2a015ca01a req-50fe462c-35f3-4d6f-8c53-6a495fd1cf17 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Updated VIF entry in instance network info cache for port 57d28229-6c45-40b7-8947-c2e3f1589ba5. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:26:46 user nova-compute[72000]: DEBUG nova.network.neutron [req-d453226f-3670-451e-a280-3a2a015ca01a req-50fe462c-35f3-4d6f-8c53-6a495fd1cf17 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Updating instance_info_cache with network_info: [{"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:26:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d453226f-3670-451e-a280-3a2a015ca01a req-50fe462c-35f3-4d6f-8c53-6a495fd1cf17 service nova] Releasing lock "refresh_cache-fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG os_brick.utils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30834a92-c94e-40d8-bb9c-4440c0087f63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c1bb2-4013-46c2-a679-f2a6fc0cb79e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1705907-ba33-456c-868a-01c049d616d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f250e89-a997-453b-a16e-072ee7b943a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:26:49 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[69365b4f-f387-4eeb-86ca-f7cc1fc89008]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG os_brick.utils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Updating existing volume attachment record: a233724a-d50d-4571-9581-54823bd59468 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG nova.compute.manager [req-8579bfcb-585f-4e8f-a1f5-2a0b0c759fcd req-88f67b08-b571-478d-bc78-fc6c1b3fd232 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received event network-changed-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG nova.compute.manager [req-8579bfcb-585f-4e8f-a1f5-2a0b0c759fcd req-88f67b08-b571-478d-bc78-fc6c1b3fd232 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Refreshing instance network info cache due to event network-changed-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8579bfcb-585f-4e8f-a1f5-2a0b0c759fcd req-88f67b08-b571-478d-bc78-fc6c1b3fd232 service nova] Acquiring lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8579bfcb-585f-4e8f-a1f5-2a0b0c759fcd req-88f67b08-b571-478d-bc78-fc6c1b3fd232 service nova] Acquired lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:26:49 user nova-compute[72000]: DEBUG nova.network.neutron [req-8579bfcb-585f-4e8f-a1f5-2a0b0c759fcd req-88f67b08-b571-478d-bc78-fc6c1b3fd232 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Refreshing network info cache for port 11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:26:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:50 user nova-compute[72000]: DEBUG nova.network.neutron [req-8579bfcb-585f-4e8f-a1f5-2a0b0c759fcd req-88f67b08-b571-478d-bc78-fc6c1b3fd232 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updated VIF entry in instance network info cache for port 11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:26:50 user nova-compute[72000]: DEBUG nova.network.neutron [req-8579bfcb-585f-4e8f-a1f5-2a0b0c759fcd req-88f67b08-b571-478d-bc78-fc6c1b3fd232 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating instance_info_cache with network_info: [{"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:26:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8579bfcb-585f-4e8f-a1f5-2a0b0c759fcd req-88f67b08-b571-478d-bc78-fc6c1b3fd232 service nova] Releasing lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:26:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG nova.objects.instance [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:55 user nova-compute[72000]: INFO nova.compute.manager [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attaching volume 528a8c83-1575-4969-89a1-39b514065660 to /dev/vdb
Aug 16 18:26:55 user nova-compute[72000]: DEBUG os_brick.utils [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f8f3e3-4371-410d-b8af-139c919e54f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c0afe9-8a84-47db-9599-38c73f3856ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8067b744-31a5-4847-987c-5a7bdbb67333]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21102a6-33db-4f23-8daf-6f005265b96a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:26:55 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:26:55 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5615af-3107-4f7a-a032-2df13234b991]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG os_brick.utils [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:26:55 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating existing volume attachment record: b881d831-3572-4c88-a3f4-0d6d599208ba {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:26:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Creating image(s)
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Ensure instance console log exists: /opt/stack/data/nova/instances/fd8026c4-2ad9-4359-acd5-37b3cbe08a2f/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Start _get_guest_xml network_info=[{"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T18:26:33Z,direct_url=<?>,disk_format='qcow2',id=d709a04a-cee5-40f6-bf1c-dfdf2adc967a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1650096501',owner='b758c455ec774042967fb617787c1cbd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T18:26:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gsfrqPoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd8026c4-2ad9-4359-acd5-37b3cbe08a2f', 'attached_at': '', 'detached_at': '', 'volume_id': '1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf', 'serial': '1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf'}, 'attachment_id': 'a233724a-d50d-4571-9581-54823bd59468', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:26:59 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:26:59 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-16T18:26:33Z,direct_url=<?>,disk_format='qcow2',id=d709a04a-cee5-40f6-bf1c-dfdf2adc967a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1650096501',owner='b758c455ec774042967fb617787c1cbd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-16T18:26:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gsfrqPoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:26:59 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:26:59 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:26:59 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ac32fd-cb1e-4c1c-8929-9b0427e5849f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:26:59 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0300d223-5687-4590-bd03-3d281e3181c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf] added
Aug 16 18:26:59 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:59 user nova-compute[72000]: WARNING nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid a18d4e32-c275-4c65-a9b7-25f32f43c378 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 6fccbca3-d0de-4797-8adc-63c1cc470b3d {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid fd8026c4-2ad9-4359-acd5-37b3cbe08a2f {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "a18d4e32-c275-4c65-a9b7-25f32f43c378" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e7ab34-52b4-463b-b4f9-797565097fa5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[306ad3a1-23df-4ecc-99db-1daec1316850]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gsfrqPoC {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gsfrqPoC" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e890240-7159-4095-96a0-36d80de62009]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gsfrqPoC'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d118b6-b0a5-4c0d-8dfe-ff88178f65a5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c522412-2b67-4915-97c4-b4ddac7bddfb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:26:59 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:26:59 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:26:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[78705b15-1908-4900-ab87-2de2a985be46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf, portal: 172.16.0.220,3260]
Aug 16 18:27:00 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf, portal: 172.16.0.220,3260] successful.
Aug 16 18:27:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6024bfe-091f-495a-bdd8-4546f5158a55]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[adca33e6-4659-4ed5-9457-e0b3d06f62c0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:00 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:00 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:00 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cead8b-5a49-425d-8caa-fee2def30afd]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gsfrqPoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:27:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23938333434643864', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938333434643864', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1738682502',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1738682502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1738682502',id=39,image_ref='d709a04a-cee5-40f6-bf1c-dfdf2adc967a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8PQuR2fo6TLGmy0zSImpU2Vg68yF/kSxH6HieYUP7x/oHuT7+BnIXRf8lr96EHuOXmvJPCiBGzfEiV8zudKlgdDrmFZmNN8V3XZSTguJsyIJIp+Y96cGlHlXdYH4EGkg==',key_name='tempest-keypair-2085605783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-kn4gj2ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-109968882',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:26:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1107151852b84f3185157fff0c0f3495',uuid=fd8026c4-2ad9-4359-acd5-37b3cbe08a2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b2:d6,bridge_name='br-int',has_traffic_filtering=True,id=57d28229-6c45-40b7-8947-c2e3f1589ba5,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d28229-6c') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.objects.instance [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'pci_devices' on Instance uuid fd8026c4-2ad9-4359-acd5-37b3cbe08a2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:27:01 user nova-compute[72000]:   <uuid>fd8026c4-2ad9-4359-acd5-37b3cbe08a2f</uuid>
Aug 16 18:27:01 user nova-compute[72000]:   <name>instance-00000027</name>
Aug 16 18:27:01 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:27:01 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:27:01 user nova-compute[72000]:   <metadata>
Aug 16 18:27:01 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:27:01 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:27:01 user nova-compute[72000]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1738682502</nova:name>
Aug 16 18:27:01 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:26:59</nova:creationTime>
Aug 16 18:27:01 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:27:01 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:27:01 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:27:01 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:27:01 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:27:01 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:27:01 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:27:01 user nova-compute[72000]:       <nova:owner>
Aug 16 18:27:01 user nova-compute[72000]:         <nova:user uuid="1107151852b84f3185157fff0c0f3495">tempest-TestVolumeBootPattern-109968882-project-member</nova:user>
Aug 16 18:27:01 user nova-compute[72000]:         <nova:project uuid="b758c455ec774042967fb617787c1cbd">tempest-TestVolumeBootPattern-109968882</nova:project>
Aug 16 18:27:01 user nova-compute[72000]:       </nova:owner>
Aug 16 18:27:01 user nova-compute[72000]:       <nova:root type="image" uuid="d709a04a-cee5-40f6-bf1c-dfdf2adc967a"/>
Aug 16 18:27:01 user nova-compute[72000]:       <nova:ports>
Aug 16 18:27:01 user nova-compute[72000]:         <nova:port uuid="57d28229-6c45-40b7-8947-c2e3f1589ba5">
Aug 16 18:27:01 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 18:27:01 user nova-compute[72000]:         </nova:port>
Aug 16 18:27:01 user nova-compute[72000]:       </nova:ports>
Aug 16 18:27:01 user nova-compute[72000]:     </nova:instance>
Aug 16 18:27:01 user nova-compute[72000]:   </metadata>
Aug 16 18:27:01 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:27:01 user nova-compute[72000]:     <system>
Aug 16 18:27:01 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:27:01 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:27:01 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:27:01 user nova-compute[72000]:       <entry name="serial">fd8026c4-2ad9-4359-acd5-37b3cbe08a2f</entry>
Aug 16 18:27:01 user nova-compute[72000]:       <entry name="uuid">fd8026c4-2ad9-4359-acd5-37b3cbe08a2f</entry>
Aug 16 18:27:01 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:27:01 user nova-compute[72000]:     </system>
Aug 16 18:27:01 user nova-compute[72000]:   </sysinfo>
Aug 16 18:27:01 user nova-compute[72000]:   <os>
Aug 16 18:27:01 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:27:01 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:27:01 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:27:01 user nova-compute[72000]:   </os>
Aug 16 18:27:01 user nova-compute[72000]:   <features>
Aug 16 18:27:01 user nova-compute[72000]:     <acpi/>
Aug 16 18:27:01 user nova-compute[72000]:     <apic/>
Aug 16 18:27:01 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:27:01 user nova-compute[72000]:   </features>
Aug 16 18:27:01 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:27:01 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:27:01 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:27:01 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:27:01 user nova-compute[72000]:   </clock>
Aug 16 18:27:01 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:27:01 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:27:01 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:27:01 user nova-compute[72000]:   </cpu>
Aug 16 18:27:01 user nova-compute[72000]:   <devices>
Aug 16 18:27:01 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:27:01 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:27:01 user nova-compute[72000]:       <source dev="/dev/sdc"/>
Aug 16 18:27:01 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:27:01 user nova-compute[72000]:       <serial>1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf</serial>
Aug 16 18:27:01 user nova-compute[72000]:     </disk>
Aug 16 18:27:01 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:27:01 user nova-compute[72000]:       <mac address="fa:16:3e:03:b2:d6"/>
Aug 16 18:27:01 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:27:01 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:27:01 user nova-compute[72000]:       <target dev="tap57d28229-6c"/>
Aug 16 18:27:01 user nova-compute[72000]:     </interface>
Aug 16 18:27:01 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:27:01 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/fd8026c4-2ad9-4359-acd5-37b3cbe08a2f/console.log" append="off"/>
Aug 16 18:27:01 user nova-compute[72000]:     </serial>
Aug 16 18:27:01 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:27:01 user nova-compute[72000]:     <video>
Aug 16 18:27:01 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:27:01 user nova-compute[72000]:     </video>
Aug 16 18:27:01 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:27:01 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:27:01 user nova-compute[72000]:     </rng>
Aug 16 18:27:01 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:27:01 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:27:01 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:27:01 user nova-compute[72000]:     </memballoon>
Aug 16 18:27:01 user nova-compute[72000]:   </devices>
Aug 16 18:27:01 user nova-compute[72000]: </domain>
Aug 16 18:27:01 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1738682502',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1738682502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1738682502',id=39,image_ref='d709a04a-cee5-40f6-bf1c-dfdf2adc967a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8PQuR2fo6TLGmy0zSImpU2Vg68yF/kSxH6HieYUP7x/oHuT7+BnIXRf8lr96EHuOXmvJPCiBGzfEiV8zudKlgdDrmFZmNN8V3XZSTguJsyIJIp+Y96cGlHlXdYH4EGkg==',key_name='tempest-keypair-2085605783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-kn4gj2ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-109968882',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:26:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1107151852b84f3185157fff0c0f3495',uuid=fd8026c4-2ad9-4359-acd5-37b3cbe08a2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b2:d6,bridge_name='br-int',has_traffic_filtering=True,id=57d28229-6c45-40b7-8947-c2e3f1589ba5,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d28229-6c') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG os_vif [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b2:d6,bridge_name='br-int',has_traffic_filtering=True,id=57d28229-6c45-40b7-8947-c2e3f1589ba5,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d28229-6c') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57d28229-6c, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap57d28229-6c, col_values=(('external_ids', {'iface-id': '57d28229-6c45-40b7-8947-c2e3f1589ba5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:b2:d6', 'vm-uuid': 'fd8026c4-2ad9-4359-acd5-37b3cbe08a2f'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:01 user nova-compute[72000]: INFO os_vif [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b2:d6,bridge_name='br-int',has_traffic_filtering=True,id=57d28229-6c45-40b7-8947-c2e3f1589ba5,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d28229-6c')
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:27:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No VIF found with MAC fa:16:3e:03:b2:d6, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:27:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-7cc3038c-ea58-4ad0-b2f5-2e19242b5a07 req-da1ab430-5c6a-4939-a564-fefa163e48d3 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received event network-vif-plugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:27:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7cc3038c-ea58-4ad0-b2f5-2e19242b5a07 req-da1ab430-5c6a-4939-a564-fefa163e48d3 service nova] Acquiring lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:27:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7cc3038c-ea58-4ad0-b2f5-2e19242b5a07 req-da1ab430-5c6a-4939-a564-fefa163e48d3 service nova] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7cc3038c-ea58-4ad0-b2f5-2e19242b5a07 req-da1ab430-5c6a-4939-a564-fefa163e48d3 service nova] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-7cc3038c-ea58-4ad0-b2f5-2e19242b5a07 req-da1ab430-5c6a-4939-a564-fefa163e48d3 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] No waiting events found dispatching network-vif-plugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:27:02 user nova-compute[72000]: WARNING nova.compute.manager [req-7cc3038c-ea58-4ad0-b2f5-2e19242b5a07 req-da1ab430-5c6a-4939-a564-fefa163e48d3 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received unexpected event network-vif-plugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 for instance with vm_state building and task_state spawning.
Aug 16 18:27:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210424.5751083, fd8026c4-2ad9-4359-acd5-37b3cbe08a2f => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:27:04 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] VM Resumed (Lifecycle Event)
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:27:04 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Instance spawned successfully.
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:27:04 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210424.5763402, fd8026c4-2ad9-4359-acd5-37b3cbe08a2f => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:27:04 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] VM Started (Lifecycle Event)
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:27:04 user nova-compute[72000]: INFO nova.compute.manager [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Took 4.96 seconds to spawn the instance on the hypervisor.
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:27:04 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-809dcbd8-c87a-4c07-9a8c-a7350c95ba16 req-c3e80e63-31ba-475b-b46c-0fc5cb2d7274 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received event network-vif-plugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-809dcbd8-c87a-4c07-9a8c-a7350c95ba16 req-c3e80e63-31ba-475b-b46c-0fc5cb2d7274 service nova] Acquiring lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-809dcbd8-c87a-4c07-9a8c-a7350c95ba16 req-c3e80e63-31ba-475b-b46c-0fc5cb2d7274 service nova] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-809dcbd8-c87a-4c07-9a8c-a7350c95ba16 req-c3e80e63-31ba-475b-b46c-0fc5cb2d7274 service nova] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-809dcbd8-c87a-4c07-9a8c-a7350c95ba16 req-c3e80e63-31ba-475b-b46c-0fc5cb2d7274 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] No waiting events found dispatching network-vif-plugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:27:04 user nova-compute[72000]: WARNING nova.compute.manager [req-809dcbd8-c87a-4c07-9a8c-a7350c95ba16 req-c3e80e63-31ba-475b-b46c-0fc5cb2d7274 service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received unexpected event network-vif-plugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 for instance with vm_state building and task_state spawning.
Aug 16 18:27:04 user nova-compute[72000]: INFO nova.compute.manager [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Took 21.46 seconds to build instance.
Aug 16 18:27:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69239187-4bb4-40f6-a4df-b52d9419b55e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.550s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.963s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:04 user nova-compute[72000]: INFO nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:27:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoFmBRAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:27:06 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:27:06 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:27:06 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6bbfc3-fea0-4c0d-bcb7-2bbc151ba37d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:27:06 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73f7849-149d-4734-ad4c-5438102c15fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660] added
Aug 16 18:27:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58427da-9457-4fc3-9b74-6ef1988593e5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[43492b87-dfe5-42bd-afe7-24486600abee]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IoFmBRAK {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IoFmBRAK" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[638a815c-dec4-45ce-9870-555c8ed45e4f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IoFmBRAK'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1d3dc3-4ee9-4675-bbd8-b44e120df101]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[224607dd-1a6d-404a-91da-a3862e475278]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:06 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:06 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c16d7d-824b-4f53-b5c5-1ab9118cf3bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660, portal: 172.16.0.220,3260]
Aug 16 18:27:06 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660, portal: 172.16.0.220,3260] successful.
Aug 16 18:27:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dbdbfd-d205-4ca1-afc9-e110f05e9c73]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5842f2ea-72d3-4d88-b0bc-170af75679ec]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:06 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:06 user nova-compute[72000]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 (non-flash)
Aug 16 18:27:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:06 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:06 user nova-compute[72000]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 (non-flash)
Aug 16 18:27:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4208a664-2ab4-49f9-bf6b-399b3ad481c7]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:27:07 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:27:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoFmBRAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:27:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:27:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23838353563353433', 'path': '/dev/sdd'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:27:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838353563353433', 'path': '/dev/sdd'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:27:07 user nova-compute[72000]: DEBUG nova.objects.instance [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:27:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:27:07 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:27:07 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:27:07 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:27:07 user nova-compute[72000]:   <serial>528a8c83-1575-4969-89a1-39b514065660</serial>
Aug 16 18:27:07 user nova-compute[72000]: </disk>
Aug 16 18:27:07 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:27:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:27:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:27:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No VIF found with MAC fa:16:3e:b9:98:bd, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:27:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d0cf0251-fce0-4d16-a1b8-9df0b0c4a3f0 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.770s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.432s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:27:27 user nova-compute[72000]: INFO nova.compute.claims [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Claim successful on node user
Aug 16 18:27:27 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:27:27 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:27:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:27:27 user nova-compute[72000]: INFO nova.virt.block_device [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Booting with volume de0fdb83-e5af-4c05-ba33-702de76f79ca at /dev/vda
Aug 16 18:27:27 user nova-compute[72000]: DEBUG nova.policy [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb9c67db30d3443eaf28670635863118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72c4769a48b847f994e32e7c01bd39e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG os_brick.utils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f9f2dd-6551-4c66-85a8-d742eb2791da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a6ebb-fab1-437c-a497-ae098ab84293]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5296d3c-7975-4684-9979-6921f2c72c4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3617169c-3db4-4c44-bda9-303159ae4f9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:27:27 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:27:27 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5942b9de-e949-4c7f-b282-aa49c5cde6e7]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG os_brick.utils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:27:27 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating existing volume attachment record: b74e8245-5f9d-4dd7-9a22-dab0796c76c6 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:27:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Successfully created port: 46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Successfully updated port: 46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquired lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-9f4ba4bc-68ab-4fb5-b6a9-1e0c61866940 req-8f5eba01-d9c4-404e-9857-3d16af4b27d5 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-changed-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-9f4ba4bc-68ab-4fb5-b6a9-1e0c61866940 req-8f5eba01-d9c4-404e-9857-3d16af4b27d5 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Refreshing instance network info cache due to event network-changed-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9f4ba4bc-68ab-4fb5-b6a9-1e0c61866940 req-8f5eba01-d9c4-404e-9857-3d16af4b27d5 service nova] Acquiring lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG nova.network.neutron [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating instance_info_cache with network_info: [{"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Releasing lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Instance network_info: |[{"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9f4ba4bc-68ab-4fb5-b6a9-1e0c61866940 req-8f5eba01-d9c4-404e-9857-3d16af4b27d5 service nova] Acquired lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-9f4ba4bc-68ab-4fb5-b6a9-1e0c61866940 req-8f5eba01-d9c4-404e-9857-3d16af4b27d5 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Refreshing network info cache for port 46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-9f4ba4bc-68ab-4fb5-b6a9-1e0c61866940 req-8f5eba01-d9c4-404e-9857-3d16af4b27d5 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updated VIF entry in instance network info cache for port 46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-9f4ba4bc-68ab-4fb5-b6a9-1e0c61866940 req-8f5eba01-d9c4-404e-9857-3d16af4b27d5 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating instance_info_cache with network_info: [{"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:27:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9f4ba4bc-68ab-4fb5-b6a9-1e0c61866940 req-8f5eba01-d9c4-404e-9857-3d16af4b27d5 service nova] Releasing lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:27:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:27:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:27:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:27:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:27:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:27:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:27:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:27:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Updating instance_info_cache with network_info: [{"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-a18d4e32-c275-4c65-a9b7-25f32f43c378" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:37 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:27:37 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8169MB free_disk=23.64544677734375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:37 user nova-compute[72000]: INFO nova.compute.manager [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Detaching volume 528a8c83-1575-4969-89a1-39b514065660
Aug 16 18:27:37 user nova-compute[72000]: INFO nova.virt.block_device [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attempting to driver detach volume 528a8c83-1575-4969-89a1-39b514065660 from mountpoint /dev/vdb
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Attempting to detach device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:27:37 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:27:37 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:27:37 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:27:37 user nova-compute[72000]:   <serial>528a8c83-1575-4969-89a1-39b514065660</serial>
Aug 16 18:27:37 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:27:37 user nova-compute[72000]: </disk>
Aug 16 18:27:37 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:27:37 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Successfully detached device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the persistent domain config.
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:27:37 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:27:37 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:27:37 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:27:37 user nova-compute[72000]:   <serial>528a8c83-1575-4969-89a1-39b514065660</serial>
Aug 16 18:27:37 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:27:37 user nova-compute[72000]: </disk>
Aug 16 18:27:37 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a18d4e32-c275-4c65-a9b7-25f32f43c378 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6fccbca3-d0de-4797-8adc-63c1cc470b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance fd8026c4-2ad9-4359-acd5-37b3cbe08a2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692210457.8337398, 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:27:37 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Successfully detached device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the live domain config.
Aug 16 18:27:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoFmBRAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:27:37 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:27:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c97ae4-e69a-448e-a0a9-9c9bbf3c52d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feaf3e6-d0c0-4d02-8eba-c9827a90c1bf]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:37 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:37 user nova-compute[72000]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 (non-flash)
Aug 16 18:27:37 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:37 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:37 user nova-compute[72000]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 (non-flash)
Aug 16 18:27:37 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01c85d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660'): ({'sdd'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Removing single pathed devices sdd {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d5743-9d15-469c-9ac4-c9c48804d5f6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90506e8-0d16-460e-98e3-8d9a11bcf0e6]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Flushing IO for device /dev/sdd {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[163b7d33-c42e-4a0d-a4f2-b77a1827f337]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:27:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[316f355d-83d9-4607-8208-e5a364917d7f]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f04db1b-6c25-4d2e-b9ff-e97510026d7d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ee112e-2310-44c3-ba2c-03eba6cd608f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660, portal: 172.16.0.220,3260]
Aug 16 18:27:38 user nova-compute[72000]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660, portal: 172.16.0.220,3260] successful.
Aug 16 18:27:38 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:528a8c83-1575-4969-89a1-39b514065660 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ca76a6-e353-46f5-9de0-19e317c5146e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== disconnect_volume: return (289ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:27:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:27:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Creating image(s)
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Ensure instance console log exists: /opt/stack/data/nova/instances/fa44ba0e-28c7-4915-8cd0-51fe06eb35f5/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Start _get_guest_xml network_info=[{"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqIKlrNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa44ba0e-28c7-4915-8cd0-51fe06eb35f5', 'attached_at': '', 'detached_at': '', 'volume_id': 'de0fdb83-e5af-4c05-ba33-702de76f79ca', 'serial': 'de0fdb83-e5af-4c05-ba33-702de76f79ca'}, 'attachment_id': 'b74e8245-5f9d-4dd7-9a22-dab0796c76c6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:27:39 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:27:39 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqIKlrNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:27:39 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:27:39 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:27:39 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a1256ab2-9088-4a58-b0ff-5f675e5ae278 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.797s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5474d7-5932-49ff-abcc-22c0cc926094]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:27:39 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82aba89-7a2e-4d6f-93aa-41c4cde8040d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca] added
Aug 16 18:27:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c998ffb1-0f36-447d-8f71-80ff2a5060c9]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e85e06-121b-45f2-8cfe-5e46725bcac7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zqIKlrNo {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zqIKlrNo" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[93615434-453c-4f12-adf2-f346dd403680]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zqIKlrNo'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[494f2d9a-46ff-4cb4-8c97-d1589e56c867]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b54a400-806e-4fbf-9810-72177ba7c8a6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:39 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:39 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[04035ea1-81f7-4f71-b49e-8f5730f4f141]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260]
Aug 16 18:27:39 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260] successful.
Aug 16 18:27:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec68a11-b0fc-42b7-9450-b206a9ff5631]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[547c8655-3bed-4f5f-ab96-e333230cd122]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:39 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:39 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:27:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:27:39 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:27:39 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:27:39 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[93489301-31c2-47e9-86e6-773e550275e6]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:27:39 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqIKlrNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26236616261636232', 'path': '/dev/sdd'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236616261636232', 'path': '/dev/sdd'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-306406182',display_name='tempest-ServerActionsTestOtherA-server-306406182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-306406182',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOboTwX+yPl3Cog939zVL+RXhe2iURuYdIg/tydSG7rmvgQL9izant50X7bWgjKoD0OObZiShgjaYDVLpgpQ938h9ReyNLR83Wx2HtCoNu1LYpjzQ+Y1Ln/EOXdF1uY+1g==',key_name='tempest-keypair-1361855606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-ieyg58ue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:27:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=fa44ba0e-28c7-4915-8cd0-51fe06eb35f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.objects.instance [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'pci_devices' on Instance uuid fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:27:40 user nova-compute[72000]:   <uuid>fa44ba0e-28c7-4915-8cd0-51fe06eb35f5</uuid>
Aug 16 18:27:40 user nova-compute[72000]:   <name>instance-00000028</name>
Aug 16 18:27:40 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:27:40 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:27:40 user nova-compute[72000]:   <metadata>
Aug 16 18:27:40 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:27:40 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:27:40 user nova-compute[72000]:       <nova:name>tempest-ServerActionsTestOtherA-server-306406182</nova:name>
Aug 16 18:27:40 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:27:39</nova:creationTime>
Aug 16 18:27:40 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:27:40 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:27:40 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:27:40 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:27:40 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:27:40 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:27:40 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:27:40 user nova-compute[72000]:       <nova:owner>
Aug 16 18:27:40 user nova-compute[72000]:         <nova:user uuid="fb9c67db30d3443eaf28670635863118">tempest-ServerActionsTestOtherA-1630250690-project-member</nova:user>
Aug 16 18:27:40 user nova-compute[72000]:         <nova:project uuid="72c4769a48b847f994e32e7c01bd39e0">tempest-ServerActionsTestOtherA-1630250690</nova:project>
Aug 16 18:27:40 user nova-compute[72000]:       </nova:owner>
Aug 16 18:27:40 user nova-compute[72000]:       <nova:ports>
Aug 16 18:27:40 user nova-compute[72000]:         <nova:port uuid="46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9">
Aug 16 18:27:40 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:27:40 user nova-compute[72000]:         </nova:port>
Aug 16 18:27:40 user nova-compute[72000]:       </nova:ports>
Aug 16 18:27:40 user nova-compute[72000]:     </nova:instance>
Aug 16 18:27:40 user nova-compute[72000]:   </metadata>
Aug 16 18:27:40 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:27:40 user nova-compute[72000]:     <system>
Aug 16 18:27:40 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:27:40 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:27:40 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:27:40 user nova-compute[72000]:       <entry name="serial">fa44ba0e-28c7-4915-8cd0-51fe06eb35f5</entry>
Aug 16 18:27:40 user nova-compute[72000]:       <entry name="uuid">fa44ba0e-28c7-4915-8cd0-51fe06eb35f5</entry>
Aug 16 18:27:40 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:27:40 user nova-compute[72000]:     </system>
Aug 16 18:27:40 user nova-compute[72000]:   </sysinfo>
Aug 16 18:27:40 user nova-compute[72000]:   <os>
Aug 16 18:27:40 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:27:40 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:27:40 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:27:40 user nova-compute[72000]:   </os>
Aug 16 18:27:40 user nova-compute[72000]:   <features>
Aug 16 18:27:40 user nova-compute[72000]:     <acpi/>
Aug 16 18:27:40 user nova-compute[72000]:     <apic/>
Aug 16 18:27:40 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:27:40 user nova-compute[72000]:   </features>
Aug 16 18:27:40 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:27:40 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:27:40 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:27:40 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:27:40 user nova-compute[72000]:   </clock>
Aug 16 18:27:40 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:27:40 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:27:40 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:27:40 user nova-compute[72000]:   </cpu>
Aug 16 18:27:40 user nova-compute[72000]:   <devices>
Aug 16 18:27:40 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:27:40 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:27:40 user nova-compute[72000]:       <source dev="/dev/sdd"/>
Aug 16 18:27:40 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:27:40 user nova-compute[72000]:       <serial>de0fdb83-e5af-4c05-ba33-702de76f79ca</serial>
Aug 16 18:27:40 user nova-compute[72000]:     </disk>
Aug 16 18:27:40 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:27:40 user nova-compute[72000]:       <mac address="fa:16:3e:e0:ae:d6"/>
Aug 16 18:27:40 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:27:40 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:27:40 user nova-compute[72000]:       <target dev="tap46b8ec4a-9d"/>
Aug 16 18:27:40 user nova-compute[72000]:     </interface>
Aug 16 18:27:40 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:27:40 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/fa44ba0e-28c7-4915-8cd0-51fe06eb35f5/console.log" append="off"/>
Aug 16 18:27:40 user nova-compute[72000]:     </serial>
Aug 16 18:27:40 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:27:40 user nova-compute[72000]:     <video>
Aug 16 18:27:40 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:27:40 user nova-compute[72000]:     </video>
Aug 16 18:27:40 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:27:40 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:27:40 user nova-compute[72000]:     </rng>
Aug 16 18:27:40 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:27:40 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:27:40 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:27:40 user nova-compute[72000]:     </memballoon>
Aug 16 18:27:40 user nova-compute[72000]:   </devices>
Aug 16 18:27:40 user nova-compute[72000]: </domain>
Aug 16 18:27:40 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-306406182',display_name='tempest-ServerActionsTestOtherA-server-306406182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-306406182',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOboTwX+yPl3Cog939zVL+RXhe2iURuYdIg/tydSG7rmvgQL9izant50X7bWgjKoD0OObZiShgjaYDVLpgpQ938h9ReyNLR83Wx2HtCoNu1LYpjzQ+Y1Ln/EOXdF1uY+1g==',key_name='tempest-keypair-1361855606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-ieyg58ue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:27:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=fa44ba0e-28c7-4915-8cd0-51fe06eb35f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG os_vif [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46b8ec4a-9d, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46b8ec4a-9d, col_values=(('external_ids', {'iface-id': '46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:ae:d6', 'vm-uuid': 'fa44ba0e-28c7-4915-8cd0-51fe06eb35f5'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:40 user nova-compute[72000]: INFO os_vif [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d')
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:27:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No VIF found with MAC fa:16:3e:e0:ae:d6, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:27:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-0aeacdc7-3fb6-439f-81a0-ae06f67d9005 req-e9ee55c6-0b6a-49fd-afce-47f17dfd59e1 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:27:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0aeacdc7-3fb6-439f-81a0-ae06f67d9005 req-e9ee55c6-0b6a-49fd-afce-47f17dfd59e1 service nova] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:27:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0aeacdc7-3fb6-439f-81a0-ae06f67d9005 req-e9ee55c6-0b6a-49fd-afce-47f17dfd59e1 service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0aeacdc7-3fb6-439f-81a0-ae06f67d9005 req-e9ee55c6-0b6a-49fd-afce-47f17dfd59e1 service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-0aeacdc7-3fb6-439f-81a0-ae06f67d9005 req-e9ee55c6-0b6a-49fd-afce-47f17dfd59e1 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] No waiting events found dispatching network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:27:41 user nova-compute[72000]: WARNING nova.compute.manager [req-0aeacdc7-3fb6-439f-81a0-ae06f67d9005 req-e9ee55c6-0b6a-49fd-afce-47f17dfd59e1 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received unexpected event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 for instance with vm_state building and task_state spawning.
Aug 16 18:27:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:42 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210463.9436207, fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:27:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] VM Resumed (Lifecycle Event)
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:27:43 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Instance spawned successfully.
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:27:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:27:43 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210463.946782, fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:27:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] VM Started (Lifecycle Event)
Aug 16 18:27:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:27:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:27:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-03e73715-f8bf-4151-af9e-ad98f3c1055b req-c56d5b21-c6c4-4c80-b11a-b0d2e2fd70ee service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:27:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-03e73715-f8bf-4151-af9e-ad98f3c1055b req-c56d5b21-c6c4-4c80-b11a-b0d2e2fd70ee service nova] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:27:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-03e73715-f8bf-4151-af9e-ad98f3c1055b req-c56d5b21-c6c4-4c80-b11a-b0d2e2fd70ee service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:27:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-03e73715-f8bf-4151-af9e-ad98f3c1055b req-c56d5b21-c6c4-4c80-b11a-b0d2e2fd70ee service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-03e73715-f8bf-4151-af9e-ad98f3c1055b req-c56d5b21-c6c4-4c80-b11a-b0d2e2fd70ee service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] No waiting events found dispatching network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:27:44 user nova-compute[72000]: WARNING nova.compute.manager [req-03e73715-f8bf-4151-af9e-ad98f3c1055b req-c56d5b21-c6c4-4c80-b11a-b0d2e2fd70ee service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received unexpected event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 for instance with vm_state building and task_state spawning.
Aug 16 18:27:44 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:27:44 user nova-compute[72000]: INFO nova.compute.manager [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Took 5.02 seconds to spawn the instance on the hypervisor.
Aug 16 18:27:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:27:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:44 user nova-compute[72000]: INFO nova.compute.manager [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Took 16.88 seconds to build instance.
Aug 16 18:27:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d37ccbbc-6b84-48a4-9139-f06a060d490e tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.973s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:27:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:27:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-451ddecf-0567-4167-a5e5-f4a5fea7c292 req-db9a4a52-9c83-49e5-a963-ae17b67deb54 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received event network-changed-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:28:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-451ddecf-0567-4167-a5e5-f4a5fea7c292 req-db9a4a52-9c83-49e5-a963-ae17b67deb54 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Refreshing instance network info cache due to event network-changed-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:28:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-451ddecf-0567-4167-a5e5-f4a5fea7c292 req-db9a4a52-9c83-49e5-a963-ae17b67deb54 service nova] Acquiring lock "refresh_cache-6fccbca3-d0de-4797-8adc-63c1cc470b3d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:28:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-451ddecf-0567-4167-a5e5-f4a5fea7c292 req-db9a4a52-9c83-49e5-a963-ae17b67deb54 service nova] Acquired lock "refresh_cache-6fccbca3-d0de-4797-8adc-63c1cc470b3d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:28:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-451ddecf-0567-4167-a5e5-f4a5fea7c292 req-db9a4a52-9c83-49e5-a963-ae17b67deb54 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Refreshing network info cache for port 61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:28:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-451ddecf-0567-4167-a5e5-f4a5fea7c292 req-db9a4a52-9c83-49e5-a963-ae17b67deb54 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Updated VIF entry in instance network info cache for port 61f59e1e-952e-4d43-9d5b-ec3734ba4d5c. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:28:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-451ddecf-0567-4167-a5e5-f4a5fea7c292 req-db9a4a52-9c83-49e5-a963-ae17b67deb54 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Updating instance_info_cache with network_info: [{"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:28:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-451ddecf-0567-4167-a5e5-f4a5fea7c292 req-db9a4a52-9c83-49e5-a963-ae17b67deb54 service nova] Releasing lock "refresh_cache-6fccbca3-d0de-4797-8adc-63c1cc470b3d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:28:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'flavor' on Instance uuid 6fccbca3-d0de-4797-8adc-63c1cc470b3d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:28:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:07 user nova-compute[72000]: INFO nova.compute.manager [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Attaching volume 9b402c2c-7c93-4e1b-9583-32b5983ad960 to /dev/vdb
Aug 16 18:28:07 user nova-compute[72000]: DEBUG os_brick.utils [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4f7966-d7c9-4cf0-b8ad-3875a67e4d85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d2daf1-da49-45ef-8760-e203b7389ad9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a77c96c-d6ff-4dcb-8167-626e42c27008]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4d7c7b-ba3d-4c32-a992-d502e3394fe6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:28:07 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:28:07 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[983beb1e-edf2-4c63-b26c-008742c1981a]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG os_brick.utils [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:28:07 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Updating existing volume attachment record: 25ba963f-101a-429c-8d85-9ca5f89026d2 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:28:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhitYMJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:28:17 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:28:17 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:28:17 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd010b90-bf7e-4efc-9413-397dfd537690]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:28:17 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded95e78-dbdf-4504-a200-4f58ed2851e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960] added
Aug 16 18:28:17 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfa2d86-1177-4d7c-84d6-cff032ac8d6c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b731d1d-f52a-4a3b-b807-bcc34ba93762]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhitYMJI {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhitYMJI" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcff8448-00b8-4c73-965b-ead8a8171340]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RhitYMJI'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5121e96d-2ce6-46f2-ac4a-d09f75514c08]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[af06bc1b-aa19-4fe3-a955-88cfff966d5e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:17 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:28:17 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:17 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:17 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:28:17 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:17 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:28:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c677a5be-0d8f-4606-b205-8df411d7af36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960, portal: 172.16.0.220,3260]
Aug 16 18:28:18 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960, portal: 172.16.0.220,3260] successful.
Aug 16 18:28:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[622b760e-b0ca-4ec1-a66e-1a1d7f86159f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee117e50-f2f8-4bcc-a2cb-240591c1bbb8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:18 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:28:18 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:18 user nova-compute[72000]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 (non-flash)
Aug 16 18:28:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:18 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:28:18 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:18 user nova-compute[72000]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 (non-flash)
Aug 16 18:28:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c8f7ff-3ef6-4345-a483-4cb998de3050]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhitYMJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26461396664313631', 'path': '/dev/sde'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461396664313631', 'path': '/dev/sde'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG nova.objects.instance [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'flavor' on Instance uuid 6fccbca3-d0de-4797-8adc-63c1cc470b3d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:28:19 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:28:19 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:28:19 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:28:19 user nova-compute[72000]:   <serial>9b402c2c-7c93-4e1b-9583-32b5983ad960</serial>
Aug 16 18:28:19 user nova-compute[72000]: </disk>
Aug 16 18:28:19 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] No VIF found with MAC fa:16:3e:3e:dd:0d, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:28:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-1d67bb8d-9641-4e05-b8c0-1a5aae5a67c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.551s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:20 user nova-compute[72000]: INFO nova.compute.manager [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Detaching volume 9b402c2c-7c93-4e1b-9583-32b5983ad960
Aug 16 18:28:20 user nova-compute[72000]: INFO nova.virt.block_device [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Attempting to driver detach volume 9b402c2c-7c93-4e1b-9583-32b5983ad960 from mountpoint /dev/vdb
Aug 16 18:28:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Attempting to detach device vdb from instance 6fccbca3-d0de-4797-8adc-63c1cc470b3d from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:28:20 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:28:20 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:28:20 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:28:20 user nova-compute[72000]:   <serial>9b402c2c-7c93-4e1b-9583-32b5983ad960</serial>
Aug 16 18:28:20 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:28:20 user nova-compute[72000]: </disk>
Aug 16 18:28:20 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:28:20 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully detached device vdb from instance 6fccbca3-d0de-4797-8adc-63c1cc470b3d from the persistent domain config.
Aug 16 18:28:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fccbca3-d0de-4797-8adc-63c1cc470b3d from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:28:20 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:28:20 user nova-compute[72000]:   <source dev="/dev/sde"/>
Aug 16 18:28:20 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:28:20 user nova-compute[72000]:   <serial>9b402c2c-7c93-4e1b-9583-32b5983ad960</serial>
Aug 16 18:28:20 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:28:20 user nova-compute[72000]: </disk>
Aug 16 18:28:20 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692210500.8122761, 6fccbca3-d0de-4797-8adc-63c1cc470b3d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fccbca3-d0de-4797-8adc-63c1cc470b3d {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:28:20 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully detached device vdb from instance 6fccbca3-d0de-4797-8adc-63c1cc470b3d from the live domain config.
Aug 16 18:28:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhitYMJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:28:20 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f84ea-e9cb-4194-b43c-495ea953bca2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3129f69-ffd8-4227-902e-3932d1f7cc4c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:20 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:28:20 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:20 user nova-compute[72000]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 (non-flash)
Aug 16 18:28:20 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:20 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:28:20 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:20 user nova-compute[72000]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 (non-flash)
Aug 16 18:28:20 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcfe8726440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960'): ({'sde'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Removing single pathed devices sde {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[094e8d6b-93c4-4177-a523-16284747c735]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb03cc-a74e-4523-8e86-428b9d003f67]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Flushing IO for device /dev/sde {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c90a3a1-db6f-4322-84b2-4de1e40a4fb1]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a816ccbb-410a-4f14-b9e9-609d32b67771]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:28:20 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] SCSI volumes sde have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba0a72-d625-4943-ab53-4f8fd6f96308]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0f78f7-e905-4694-820b-6239c14b9d8e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960, portal: 172.16.0.220,3260]
Aug 16 18:28:21 user nova-compute[72000]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960, portal: 172.16.0.220,3260] successful.
Aug 16 18:28:21 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b402c2c-7c93-4e1b-9583-32b5983ad960 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ae2ffc-8736-492f-82a3-26f40731c5dc]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] <== disconnect_volume: return (323ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG nova.objects.instance [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'flavor' on Instance uuid 6fccbca3-d0de-4797-8adc-63c1cc470b3d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:28:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dc9c2326-a695-4b88-bfd1-73a36bde0f8a tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:28:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:28:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:28:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:28:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:28:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:31 user nova-compute[72000]: INFO nova.compute.manager [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attaching volume fbf33bfe-a086-407c-84b8-85d97a789cd0 to /dev/vdb
Aug 16 18:28:31 user nova-compute[72000]: DEBUG os_brick.utils [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[404321ac-86bb-49a2-9a7f-718e218b26bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d0a106-058d-4760-987d-d80b81c2254f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ff37ef-7826-4ac1-b1de-8da0f5c79000]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac4f454-0d89-4b82-bc10-4987ebed4183]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:28:31 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ce3489-3572-4545-817b-fc3fe68bf3ba]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG os_brick.utils [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating existing volume attachment record: 9033ada3-da16-4ae6-b1e6-61a15408de51 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:28:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:28:32 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:28:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-fa2b1310-a6d6-4dee-9d04-04fe9ca16a2c req-99416e50-8a34-4d43-b518-ada95845e26a service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received event network-changed-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-fa2b1310-a6d6-4dee-9d04-04fe9ca16a2c req-99416e50-8a34-4d43-b518-ada95845e26a service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Refreshing instance network info cache due to event network-changed-57d28229-6c45-40b7-8947-c2e3f1589ba5. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa2b1310-a6d6-4dee-9d04-04fe9ca16a2c req-99416e50-8a34-4d43-b518-ada95845e26a service nova] Acquiring lock "refresh_cache-fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa2b1310-a6d6-4dee-9d04-04fe9ca16a2c req-99416e50-8a34-4d43-b518-ada95845e26a service nova] Acquired lock "refresh_cache-fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-fa2b1310-a6d6-4dee-9d04-04fe9ca16a2c req-99416e50-8a34-4d43-b518-ada95845e26a service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Refreshing network info cache for port 57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:28:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:35 user nova-compute[72000]: INFO nova.compute.manager [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Terminating instance
Aug 16 18:28:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-fa2b1310-a6d6-4dee-9d04-04fe9ca16a2c req-99416e50-8a34-4d43-b518-ada95845e26a service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Updated VIF entry in instance network info cache for port 57d28229-6c45-40b7-8947-c2e3f1589ba5. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-fa2b1310-a6d6-4dee-9d04-04fe9ca16a2c req-99416e50-8a34-4d43-b518-ada95845e26a service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Updating instance_info_cache with network_info: [{"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa2b1310-a6d6-4dee-9d04-04fe9ca16a2c req-99416e50-8a34-4d43-b518-ada95845e26a service nova] Releasing lock "refresh_cache-fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating instance_info_cache with network_info: [{"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:35 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Instance destroyed successfully.
Aug 16 18:28:35 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'resources' on Instance uuid fd8026c4-2ad9-4359-acd5-37b3cbe08a2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1738682502',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1738682502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1738682502',id=39,image_ref='d709a04a-cee5-40f6-bf1c-dfdf2adc967a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8PQuR2fo6TLGmy0zSImpU2Vg68yF/kSxH6HieYUP7x/oHuT7+BnIXRf8lr96EHuOXmvJPCiBGzfEiV8zudKlgdDrmFZmNN8V3XZSTguJsyIJIp+Y96cGlHlXdYH4EGkg==',key_name='tempest-keypair-2085605783',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:27:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-kn4gj2ev',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-109968882',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:27:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1107151852b84f3185157fff0c0f3495',uuid=fd8026c4-2ad9-4359-acd5-37b3cbe08a2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "address": "fa:16:3e:03:b2:d6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d28229-6c", "ovs_interfaceid": "57d28229-6c45-40b7-8947-c2e3f1589ba5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:b2:d6,bridge_name='br-int',has_traffic_filtering=True,id=57d28229-6c45-40b7-8947-c2e3f1589ba5,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d28229-6c') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG os_vif [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b2:d6,bridge_name='br-int',has_traffic_filtering=True,id=57d28229-6c45-40b7-8947-c2e3f1589ba5,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d28229-6c') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57d28229-6c, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:28:35 user nova-compute[72000]: INFO os_vif [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:b2:d6,bridge_name='br-int',has_traffic_filtering=True,id=57d28229-6c45-40b7-8947-c2e3f1589ba5,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d28229-6c')
Aug 16 18:28:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gsfrqPoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:28:35 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:28:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:28:35 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25cb280-585a-42e9-a573-53dc1200ef39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa53e08d-f088-4478-8401-9533421fe371]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:36 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:28:36 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:36 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:36 user nova-compute[72000]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf (non-flash)
Aug 16 18:28:36 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:36 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0082c6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[35683dfe-d05a-494d-8ab0-b8f80bc2700f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84810d52-2c90-4e59-bcc7-93a9d32967b7]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[856b4081-b757-47b3-8e6f-b79dcb693156]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[297b8f09-c512-41c9-bed0-9fb04a60807b]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdeb81b-163c-460e-bce3-76cb0f86db73]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[474c9ef1-5cea-4ad5-9a50-2f1f1072480a]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf, portal: 172.16.0.220,3260]
Aug 16 18:28:36 user nova-compute[72000]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf, portal: 172.16.0.220,3260] successful.
Aug 16 18:28:36 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b510de11-08e2-4434-be59-fc0e97478d7a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== disconnect_volume: return (310ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:28:36 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Deleting instance files /opt/stack/data/nova/instances/fd8026c4-2ad9-4359-acd5-37b3cbe08a2f_del
Aug 16 18:28:36 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Deletion of /opt/stack/data/nova/instances/fd8026c4-2ad9-4359-acd5-37b3cbe08a2f_del complete
Aug 16 18:28:36 user nova-compute[72000]: INFO nova.compute.manager [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received event network-vif-unplugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] Acquiring lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] No waiting events found dispatching network-vif-unplugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received event network-vif-unplugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received event network-vif-plugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] Acquiring lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] No waiting events found dispatching network-vif-plugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:28:36 user nova-compute[72000]: WARNING nova.compute.manager [req-bbdb3288-6336-440c-9d2e-16f99eca307a req-86ef8343-98b2-4acf-b14f-0f2a20c98c2b service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received unexpected event network-vif-plugged-57d28229-6c45-40b7-8947-c2e3f1589ba5 for instance with vm_state active and task_state deleting.
Aug 16 18:28:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:28:37 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Took 0.92 seconds to deallocate network for instance.
Aug 16 18:28:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-9fe269d4-4457-4179-b4b6-b8ba3e1e2a30 req-67dfb03c-388a-48fd-ab27-b9f3c12a972f service nova] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Received event network-vif-deleted-57d28229-6c45-40b7-8947-c2e3f1589ba5 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:38 user nova-compute[72000]: INFO nova.compute.manager [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Took 0.98 seconds to detach 1 volumes for instance.
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Deleting volume: 1ea44bd2-dcc7-466b-a8b3-b7a19a2560bf {{(pid=72000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 18:28:38 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:28:38 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8176MB free_disk=23.643115997314453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance a18d4e32-c275-4c65-a9b7-25f32f43c378 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6fccbca3-d0de-4797-8adc-63c1cc470b3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance fd8026c4-2ad9-4359-acd5-37b3cbe08a2f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.261s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:28:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:38 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Deleted allocations for instance fd8026c4-2ad9-4359-acd5-37b3cbe08a2f
Aug 16 18:28:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ceac7a4b-0ce8-40d7-85e1-11c4573ac582 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "fd8026c4-2ad9-4359-acd5-37b3cbe08a2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.869s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:28:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:28:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:28:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YChHzkKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:28:42 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:28:42 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:28:42 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59395dea-3779-4ef3-83d1-688c2bc5b372]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:28:42 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8282bb73-4ebb-429c-850d-8b29bda494ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0] added
Aug 16 18:28:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5b1d6d-fcb2-46e7-a979-7e883304c356]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6045782a-1dc4-48bc-8469-223961c3a395]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YChHzkKZ {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YChHzkKZ" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d731a0e-ea3f-4007-8e9d-b54230210b52]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YChHzkKZ'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5927dbd0-19ba-4e7d-8e84-5c0b3b8e1713]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2da9cc-3fd3-43d4-9e5e-4bfe1029424f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:42 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:42 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[14656f65-c9d8-4ec1-9a77-ad6bce917645]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0, portal: 172.16.0.220,3260]
Aug 16 18:28:42 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0, portal: 172.16.0.220,3260] successful.
Aug 16 18:28:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d57ac88-7d3d-4e82-9b7e-175a00477620]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a90213-83cd-4288-b745-e57c167bdb00]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:42 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:42 user nova-compute[72000]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 (non-flash)
Aug 16 18:28:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:42 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:42 user nova-compute[72000]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 (non-flash)
Aug 16 18:28:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4d56d4-3b21-416d-ac31-984240717761]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:28:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YChHzkKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:28:43 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:28:43 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23335356161326137', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:28:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335356161326137', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:28:43 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:28:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:28:43 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:28:43 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:28:43 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:28:43 user nova-compute[72000]:   <serial>fbf33bfe-a086-407c-84b8-85d97a789cd0</serial>
Aug 16 18:28:43 user nova-compute[72000]: </disk>
Aug 16 18:28:43 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:28:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:28:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:28:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No VIF found with MAC fa:16:3e:b9:98:bd, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:28:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c611636-b7fd-4677-a7fb-7f76f079dc2f tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.627s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:44 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:28:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:28:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:28:45 user nova-compute[72000]: INFO nova.compute.manager [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Detaching volume fbf33bfe-a086-407c-84b8-85d97a789cd0
Aug 16 18:28:45 user nova-compute[72000]: INFO nova.virt.block_device [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attempting to driver detach volume fbf33bfe-a086-407c-84b8-85d97a789cd0 from mountpoint /dev/vdb
Aug 16 18:28:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Attempting to detach device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:28:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:28:45 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:28:45 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:28:45 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:28:45 user nova-compute[72000]:   <serial>fbf33bfe-a086-407c-84b8-85d97a789cd0</serial>
Aug 16 18:28:45 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:28:45 user nova-compute[72000]: </disk>
Aug 16 18:28:45 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:28:45 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Successfully detached device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the persistent domain config.
Aug 16 18:28:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:28:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:28:45 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:28:45 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:28:45 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:28:45 user nova-compute[72000]:   <serial>fbf33bfe-a086-407c-84b8-85d97a789cd0</serial>
Aug 16 18:28:45 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:28:45 user nova-compute[72000]: </disk>
Aug 16 18:28:45 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:28:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692210526.1900623, 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:28:46 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Successfully detached device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the live domain config.
Aug 16 18:28:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YChHzkKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:28:46 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[010c909c-0afe-4115-a155-89764a07d92b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dda45c-c0af-4537-b079-0e4001856020]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:46 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:46 user nova-compute[72000]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 (non-flash)
Aug 16 18:28:46 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:28:46 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:28:46 user nova-compute[72000]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 (non-flash)
Aug 16 18:28:46 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd008731a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfa761f-199c-4101-80d8-13b03c25837f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b435388b-718a-4367-8a93-b2923efbad2c]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[60427b81-d2e1-4038-89a5-d1f7bccce173]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c702b4-e3bc-403b-97a0-a9849f59c846]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[243b41cc-1227-43b2-97e5-5c779e0301c3]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81a443e-bd55-4c45-a5b7-4b68e538fd7a]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0, portal: 172.16.0.220,3260]
Aug 16 18:28:46 user nova-compute[72000]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0, portal: 172.16.0.220,3260] successful.
Aug 16 18:28:46 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbf33bfe-a086-407c-84b8-85d97a789cd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[10960b6c-ebf8-40e4-a003-9e87dd1f0c64]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== disconnect_volume: return (273ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:28:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:28:47 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:28:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ae86ed35-b206-462d-a10c-9078cc7f12ee tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.743s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:28:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:50 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210515.9434705, fd8026c4-2ad9-4359-acd5-37b3cbe08a2f => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:28:50 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] VM Stopped (Lifecycle Event)
Aug 16 18:28:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0f509b0a-63ba-4b6f-8d4a-5894482de035 None None] [instance: fd8026c4-2ad9-4359-acd5-37b3cbe08a2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:28:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:28:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:29:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:10 user nova-compute[72000]: INFO nova.compute.manager [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Terminating instance
Aug 16 18:29:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:11 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Instance destroyed successfully.
Aug 16 18:29:11 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lazy-loading 'resources' on Instance uuid 6fccbca3-d0de-4797-8adc-63c1cc470b3d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:26:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-914338646',display_name='tempest-AttachVolumeNegativeTest-server-914338646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-914338646',id=38,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSUUu6TbotiCr7HelZ17bK4ZsnYO7UrrNeJEEOjvYhjk3BUjET9cqJkBhaxwQFAXgKQ9rvZkXHFver0rY0M86S1pAzxlHf95KReoqaEqnLQ460J5dJ/zMDz1tWmJrGlBA==',key_name='tempest-keypair-1196747055',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:26:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b557a84c43a47db90c0eb7054a77446',ramdisk_id='',reservation_id='r-hng4zuky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-678349136',owner_user_name='tempest-AttachVolumeNegativeTest-678349136-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:26:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfe1063b05894bfeb8f08bc29602b2fa',uuid=6fccbca3-d0de-4797-8adc-63c1cc470b3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converting VIF {"id": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "address": "fa:16:3e:3e:dd:0d", "network": {"id": "e44710bc-7d12-4802-98ec-d9c59d1508b4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1861018415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b557a84c43a47db90c0eb7054a77446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61f59e1e-95", "ovs_interfaceid": "61f59e1e-952e-4d43-9d5b-ec3734ba4d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:dd:0d,bridge_name='br-int',has_traffic_filtering=True,id=61f59e1e-952e-4d43-9d5b-ec3734ba4d5c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61f59e1e-95') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG os_vif [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:dd:0d,bridge_name='br-int',has_traffic_filtering=True,id=61f59e1e-952e-4d43-9d5b-ec3734ba4d5c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61f59e1e-95') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61f59e1e-95, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-c2f2055a-7f6a-4314-b8ff-2f9fde16339b req-59ac22ea-ad6f-4b01-ac86-36895678c97c service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received event network-vif-unplugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c2f2055a-7f6a-4314-b8ff-2f9fde16339b req-59ac22ea-ad6f-4b01-ac86-36895678c97c service nova] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c2f2055a-7f6a-4314-b8ff-2f9fde16339b req-59ac22ea-ad6f-4b01-ac86-36895678c97c service nova] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c2f2055a-7f6a-4314-b8ff-2f9fde16339b req-59ac22ea-ad6f-4b01-ac86-36895678c97c service nova] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-c2f2055a-7f6a-4314-b8ff-2f9fde16339b req-59ac22ea-ad6f-4b01-ac86-36895678c97c service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] No waiting events found dispatching network-vif-unplugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG nova.compute.manager [req-c2f2055a-7f6a-4314-b8ff-2f9fde16339b req-59ac22ea-ad6f-4b01-ac86-36895678c97c service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received event network-vif-unplugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:29:11 user nova-compute[72000]: INFO os_vif [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:dd:0d,bridge_name='br-int',has_traffic_filtering=True,id=61f59e1e-952e-4d43-9d5b-ec3734ba4d5c,network=Network(e44710bc-7d12-4802-98ec-d9c59d1508b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61f59e1e-95')
Aug 16 18:29:11 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Deleting instance files /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d_del
Aug 16 18:29:11 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Deletion of /opt/stack/data/nova/instances/6fccbca3-d0de-4797-8adc-63c1cc470b3d_del complete
Aug 16 18:29:11 user nova-compute[72000]: INFO nova.compute.manager [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 18:29:11 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:29:11 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:29:12 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:29:12 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Took 1.06 seconds to deallocate network for instance.
Aug 16 18:29:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:12 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:29:12 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:29:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:12 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Deleted allocations for instance 6fccbca3-d0de-4797-8adc-63c1cc470b3d
Aug 16 18:29:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0e1533fa-2fe5-4920-b1b4-c8742bde87c2 tempest-AttachVolumeNegativeTest-678349136 tempest-AttachVolumeNegativeTest-678349136-project-member] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.297s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-2d71d647-be5f-423d-9b26-c5eb0721141a req-cca1dda9-6f1b-432d-a950-a54931e9f458 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received event network-vif-plugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2d71d647-be5f-423d-9b26-c5eb0721141a req-cca1dda9-6f1b-432d-a950-a54931e9f458 service nova] Acquiring lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2d71d647-be5f-423d-9b26-c5eb0721141a req-cca1dda9-6f1b-432d-a950-a54931e9f458 service nova] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2d71d647-be5f-423d-9b26-c5eb0721141a req-cca1dda9-6f1b-432d-a950-a54931e9f458 service nova] Lock "6fccbca3-d0de-4797-8adc-63c1cc470b3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-2d71d647-be5f-423d-9b26-c5eb0721141a req-cca1dda9-6f1b-432d-a950-a54931e9f458 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] No waiting events found dispatching network-vif-plugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:29:13 user nova-compute[72000]: WARNING nova.compute.manager [req-2d71d647-be5f-423d-9b26-c5eb0721141a req-cca1dda9-6f1b-432d-a950-a54931e9f458 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received unexpected event network-vif-plugged-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c for instance with vm_state deleted and task_state None.
Aug 16 18:29:13 user nova-compute[72000]: DEBUG nova.compute.manager [req-2d71d647-be5f-423d-9b26-c5eb0721141a req-cca1dda9-6f1b-432d-a950-a54931e9f458 service nova] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Received event network-vif-deleted-61f59e1e-952e-4d43-9d5b-ec3734ba4d5c {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-61897533-c877-4cec-875b-91a6608e37c2 req-9d8f7bde-2385-450b-8b11-87964be015c7 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received event network-changed-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-61897533-c877-4cec-875b-91a6608e37c2 req-9d8f7bde-2385-450b-8b11-87964be015c7 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Refreshing instance network info cache due to event network-changed-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:29:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-61897533-c877-4cec-875b-91a6608e37c2 req-9d8f7bde-2385-450b-8b11-87964be015c7 service nova] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:29:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-61897533-c877-4cec-875b-91a6608e37c2 req-9d8f7bde-2385-450b-8b11-87964be015c7 service nova] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:29:18 user nova-compute[72000]: DEBUG nova.network.neutron [req-61897533-c877-4cec-875b-91a6608e37c2 req-9d8f7bde-2385-450b-8b11-87964be015c7 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Refreshing network info cache for port 6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:29:18 user nova-compute[72000]: DEBUG nova.network.neutron [req-61897533-c877-4cec-875b-91a6608e37c2 req-9d8f7bde-2385-450b-8b11-87964be015c7 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated VIF entry in instance network info cache for port 6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:29:18 user nova-compute[72000]: DEBUG nova.network.neutron [req-61897533-c877-4cec-875b-91a6608e37c2 req-9d8f7bde-2385-450b-8b11-87964be015c7 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:29:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-61897533-c877-4cec-875b-91a6608e37c2 req-9d8f7bde-2385-450b-8b11-87964be015c7 service nova] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:29:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Stashing vm_state: active {{(pid=72000) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 16 18:29:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:19 user nova-compute[72000]: DEBUG nova.objects.instance [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'pci_requests' on Instance uuid fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:29:19 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:29:19 user nova-compute[72000]: INFO nova.compute.claims [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Claim successful on node user
Aug 16 18:29:19 user nova-compute[72000]: DEBUG nova.objects.instance [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'resources' on Instance uuid fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:29:19 user nova-compute[72000]: DEBUG nova.objects.instance [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'pci_devices' on Instance uuid fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:29:19 user nova-compute[72000]: INFO nova.compute.resource_tracker [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating resource usage from migration 50506fd1-d8b7-4f38-9322-971726e704d3
Aug 16 18:29:20 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.276s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:20 user nova-compute[72000]: INFO nova.compute.manager [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Migrating
Aug 16 18:29:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquired lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-0d9320c8-1ff3-4f03-80e9-e04e86473e27 req-cd633495-bd26-4cba-8e5b-739e9590e7f5 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-changed-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-0d9320c8-1ff3-4f03-80e9-e04e86473e27 req-cd633495-bd26-4cba-8e5b-739e9590e7f5 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Refreshing instance network info cache due to event network-changed-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0d9320c8-1ff3-4f03-80e9-e04e86473e27 req-cd633495-bd26-4cba-8e5b-739e9590e7f5 service nova] Acquiring lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating instance_info_cache with network_info: [{"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Releasing lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0d9320c8-1ff3-4f03-80e9-e04e86473e27 req-cd633495-bd26-4cba-8e5b-739e9590e7f5 service nova] Acquired lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG nova.network.neutron [req-0d9320c8-1ff3-4f03-80e9-e04e86473e27 req-cd633495-bd26-4cba-8e5b-739e9590e7f5 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Refreshing network info cache for port 46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Starting migrate_disk_and_power_off {{(pid=72000) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 16 18:29:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-fd60cb18-91f9-4f44-807d-ec0f1140c6ec req-02b15b74-b041-433c-b087-fe50df2737d3 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-vif-unplugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fd60cb18-91f9-4f44-807d-ec0f1140c6ec req-02b15b74-b041-433c-b087-fe50df2737d3 service nova] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fd60cb18-91f9-4f44-807d-ec0f1140c6ec req-02b15b74-b041-433c-b087-fe50df2737d3 service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fd60cb18-91f9-4f44-807d-ec0f1140c6ec req-02b15b74-b041-433c-b087-fe50df2737d3 service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-fd60cb18-91f9-4f44-807d-ec0f1140c6ec req-02b15b74-b041-433c-b087-fe50df2737d3 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] No waiting events found dispatching network-vif-unplugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:29:21 user nova-compute[72000]: WARNING nova.compute.manager [req-fd60cb18-91f9-4f44-807d-ec0f1140c6ec req-02b15b74-b041-433c-b087-fe50df2737d3 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received unexpected event network-vif-unplugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 for instance with vm_state active and task_state resize_migrating.
Aug 16 18:29:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG nova.network.neutron [req-0d9320c8-1ff3-4f03-80e9-e04e86473e27 req-cd633495-bd26-4cba-8e5b-739e9590e7f5 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updated VIF entry in instance network info cache for port 46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG nova.network.neutron [req-0d9320c8-1ff3-4f03-80e9-e04e86473e27 req-cd633495-bd26-4cba-8e5b-739e9590e7f5 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating instance_info_cache with network_info: [{"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0d9320c8-1ff3-4f03-80e9-e04e86473e27 req-cd633495-bd26-4cba-8e5b-739e9590e7f5 service nova] Releasing lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:21 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Instance destroyed successfully.
Aug 16 18:29:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-306406182',display_name='tempest-ServerActionsTestOtherA-server-306406182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-306406182',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOboTwX+yPl3Cog939zVL+RXhe2iURuYdIg/tydSG7rmvgQL9izant50X7bWgjKoD0OObZiShgjaYDVLpgpQ938h9ReyNLR83Wx2HtCoNu1LYpjzQ+Y1Ln/EOXdF1uY+1g==',key_name='tempest-keypair-1361855606',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:27:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-ieyg58ue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:29:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=fa44ba0e-28c7-4915-8cd0-51fe06eb35f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1043406858-network", "vif_mac": "fa:16:3e:e0:ae:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1043406858-network", "vif_mac": "fa:16:3e:e0:ae:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_vif [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46b8ec4a-9d, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:29:21 user nova-compute[72000]: INFO os_vif [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d')
Aug 16 18:29:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqIKlrNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:29:21 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[42036595-d684-4a22-8626-3cfced521c6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[07871305-1b62-4683-bc33-403c3ca78c4b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:29:21 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:29:21 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:29:21 user nova-compute[72000]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:29:21 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01032b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca'): ({'sdd'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Removing single pathed devices sdd {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd305bb2-ceba-47d8-8e24-6ec2c7c9377c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cee4b7-c76c-426f-add5-e001a249eb7c]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flushing IO for device /dev/sdd {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[24757661-c5c8-479d-b0c0-9dae03159134]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c0b8a-fb18-430c-8d78-553d8df536b1]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bf34c619', '/dev/disk/by-id/scsi-26236616261636232', '/dev/disk/by-id/scsi-1SCST_BIObf34c619-b6abacb2c61e1aa1') {{(pid=83463) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[506c91a6-fb23-43a9-8324-cc53c8521a6d]: (4, None) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba97d55-f029-4e09-92c3-512b751e55bd]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f152ec11-9fc8-4f8e-9193-0ab9117b67c2]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260]
Aug 16 18:29:21 user nova-compute[72000]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260] successful.
Aug 16 18:29:21 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc28b93-2ced-46d2-8333-1f64c7dac2b1]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== disconnect_volume: return (272ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:29:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:29:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Port 46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 binding to destination host user is already ACTIVE {{(pid=72000) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 16 18:29:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquired lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG nova.compute.manager [req-a489a355-f589-4638-95bb-406f0217d0f7 req-523ab4c8-5a5b-4c02-bb76-785ee802ad4f service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a489a355-f589-4638-95bb-406f0217d0f7 req-523ab4c8-5a5b-4c02-bb76-785ee802ad4f service nova] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a489a355-f589-4638-95bb-406f0217d0f7 req-523ab4c8-5a5b-4c02-bb76-785ee802ad4f service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a489a355-f589-4638-95bb-406f0217d0f7 req-523ab4c8-5a5b-4c02-bb76-785ee802ad4f service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG nova.compute.manager [req-a489a355-f589-4638-95bb-406f0217d0f7 req-523ab4c8-5a5b-4c02-bb76-785ee802ad4f service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] No waiting events found dispatching network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:29:23 user nova-compute[72000]: WARNING nova.compute.manager [req-a489a355-f589-4638-95bb-406f0217d0f7 req-523ab4c8-5a5b-4c02-bb76-785ee802ad4f service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received unexpected event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 for instance with vm_state active and task_state resize_migrated.
Aug 16 18:29:23 user nova-compute[72000]: DEBUG nova.network.neutron [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating instance_info_cache with network_info: [{"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Releasing lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG os_brick.utils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b3547f-d69f-4c95-a393-76e83721b866]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0221ea-c8d8-46eb-adbb-9843f3bab489]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec9bf9a-18f7-4f5a-a4ed-8810225b4345]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[156c8e18-7bda-4e19-af58-be45b9761fbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:29:23 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:29:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c16cd92-00d2-412c-869f-2c5b01c52e2c]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:29:23 user nova-compute[72000]: DEBUG os_brick.utils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:29:26 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210551.4849722, 6fccbca3-d0de-4797-8adc-63c1cc470b3d => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:29:26 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] VM Stopped (Lifecycle Event)
Aug 16 18:29:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-910b39dc-eb60-4d98-879a-f94f1daffa79 None None] [instance: 6fccbca3-d0de-4797-8adc-63c1cc470b3d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:29:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "a18d4e32-c275-4c65-a9b7-25f32f43c378" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:32 user nova-compute[72000]: INFO nova.compute.manager [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Terminating instance
Aug 16 18:29:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-fa6c05bc-9500-4e24-ac67-b64b0f6654ea req-b84e06ff-d3d3-4272-acd7-3fa56e4f3a1f service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received event network-vif-unplugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa6c05bc-9500-4e24-ac67-b64b0f6654ea req-b84e06ff-d3d3-4272-acd7-3fa56e4f3a1f service nova] Acquiring lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa6c05bc-9500-4e24-ac67-b64b0f6654ea req-b84e06ff-d3d3-4272-acd7-3fa56e4f3a1f service nova] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-fa6c05bc-9500-4e24-ac67-b64b0f6654ea req-b84e06ff-d3d3-4272-acd7-3fa56e4f3a1f service nova] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-fa6c05bc-9500-4e24-ac67-b64b0f6654ea req-b84e06ff-d3d3-4272-acd7-3fa56e4f3a1f service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] No waiting events found dispatching network-vif-unplugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-fa6c05bc-9500-4e24-ac67-b64b0f6654ea req-b84e06ff-d3d3-4272-acd7-3fa56e4f3a1f service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received event network-vif-unplugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:29:32 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Instance destroyed successfully.
Aug 16 18:29:32 user nova-compute[72000]: DEBUG nova.objects.instance [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'resources' on Instance uuid a18d4e32-c275-4c65-a9b7-25f32f43c378 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:24:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-230507419',display_name='tempest-TestVolumeBootPattern-volume-backed-server-230507419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-230507419',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXTO0qOY74shzu6C+T3RvxTkCtJ5En7miZfG/lOvyxidaTF6h3oN3q9+nDlUiVbfF7B3q8ZTdfUnpFFa+sE3bhQ8Js4cyd3Fw9t1eAfNyvjLVYAAnzNbWE8JPXGlRiVhA==',key_name='tempest-keypair-1388305890',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-0ff4x1e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:25:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1107151852b84f3185157fff0c0f3495',uuid=a18d4e32-c275-4c65-a9b7-25f32f43c378,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "address": "fa:16:3e:e0:9b:c6", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b1745c-ee", "ovs_interfaceid": "f1b1745c-ee66-4fcf-a2e3-864d5eb34407", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:9b:c6,bridge_name='br-int',has_traffic_filtering=True,id=f1b1745c-ee66-4fcf-a2e3-864d5eb34407,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b1745c-ee') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_vif [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:9b:c6,bridge_name='br-int',has_traffic_filtering=True,id=f1b1745c-ee66-4fcf-a2e3-864d5eb34407,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b1745c-ee') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1b1745c-ee, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:29:32 user nova-compute[72000]: INFO os_vif [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:9b:c6,bridge_name='br-int',has_traffic_filtering=True,id=f1b1745c-ee66-4fcf-a2e3-864d5eb34407,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b1745c-ee')
Aug 16 18:29:32 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIbDLZTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:29:32 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[028c1503-b089-475f-bfe9-aba5eec6ce8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f63a2da-b53d-46e0-9538-102a84d4c633]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:29:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 (non-flash)
Aug 16 18:29:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01056c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[827d7685-dee1-4cb0-a475-9742f41a214e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d788165-1614-4b0d-9fc2-b01ab49b9d99]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef171f8c-5e83-4732-ab15-2505b6056d7e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[de29e8e5-a785-4dbf-b6a1-2680e2a5edb1]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23939653238636165', '/dev/disk/by-id/scsi-1SCST_BIO5f7ac789-99e28cae69a83891', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5f7ac789') {{(pid=83463) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78dcf06-b2c0-432f-804d-f6b1872392c9]: (4, None) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:29:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e42e53-764c-486f-8a03-7647f50b6d21]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4ecec3-517b-466e-8575-2ffed6bd4e6d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78, portal: 172.16.0.220,3260]
Aug 16 18:29:33 user nova-compute[72000]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78, portal: 172.16.0.220,3260] successful.
Aug 16 18:29:33 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[079165fc-1940-42fa-bd67-f2bc1dd9d1bc]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== disconnect_volume: return (287ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:29:33 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Deleting instance files /opt/stack/data/nova/instances/a18d4e32-c275-4c65-a9b7-25f32f43c378_del
Aug 16 18:29:33 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Deletion of /opt/stack/data/nova/instances/a18d4e32-c275-4c65-a9b7-25f32f43c378_del complete
Aug 16 18:29:33 user nova-compute[72000]: INFO nova.compute.manager [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 16 18:29:33 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:29:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:29:34 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:29:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-2003364c-3ca1-4185-a676-f9537d4347f9 req-aa8e1a90-83d1-416e-8eb4-5c6ad3ebe046 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received event network-vif-plugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2003364c-3ca1-4185-a676-f9537d4347f9 req-aa8e1a90-83d1-416e-8eb4-5c6ad3ebe046 service nova] Acquiring lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2003364c-3ca1-4185-a676-f9537d4347f9 req-aa8e1a90-83d1-416e-8eb4-5c6ad3ebe046 service nova] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2003364c-3ca1-4185-a676-f9537d4347f9 req-aa8e1a90-83d1-416e-8eb4-5c6ad3ebe046 service nova] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-2003364c-3ca1-4185-a676-f9537d4347f9 req-aa8e1a90-83d1-416e-8eb4-5c6ad3ebe046 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] No waiting events found dispatching network-vif-plugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:29:34 user nova-compute[72000]: WARNING nova.compute.manager [req-2003364c-3ca1-4185-a676-f9537d4347f9 req-aa8e1a90-83d1-416e-8eb4-5c6ad3ebe046 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received unexpected event network-vif-plugged-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 for instance with vm_state active and task_state deleting.
Aug 16 18:29:34 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Took 1.28 seconds to deallocate network for instance.
Aug 16 18:29:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-bb54ed95-639a-47db-8f64-00cb549ad214 req-c3e5ab1d-043d-407d-9490-1b24bd873700 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Received event network-vif-deleted-f1b1745c-ee66-4fcf-a2e3-864d5eb34407 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:34 user nova-compute[72000]: INFO nova.compute.manager [req-bb54ed95-639a-47db-8f64-00cb549ad214 req-c3e5ab1d-043d-407d-9490-1b24bd873700 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Neutron deleted interface f1b1745c-ee66-4fcf-a2e3-864d5eb34407; detaching it from the instance and deleting it from the info cache
Aug 16 18:29:34 user nova-compute[72000]: DEBUG nova.network.neutron [req-bb54ed95-639a-47db-8f64-00cb549ad214 req-c3e5ab1d-043d-407d-9490-1b24bd873700 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:29:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-bb54ed95-639a-47db-8f64-00cb549ad214 req-c3e5ab1d-043d-407d-9490-1b24bd873700 service nova] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Detach interface failed, port_id=f1b1745c-ee66-4fcf-a2e3-864d5eb34407, reason: Instance a18d4e32-c275-4c65-a9b7-25f32f43c378 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:29:35 user nova-compute[72000]: INFO nova.compute.manager [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Took 0.84 seconds to detach 1 volumes for instance.
Aug 16 18:29:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Deleting volume: fbb24ad3-7f1d-43e4-bfc6-df01e9e8df78 {{(pid=72000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 18:29:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:35 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:29:35 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:29:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:35 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Deleted allocations for instance a18d4e32-c275-4c65-a9b7-25f32f43c378
Aug 16 18:29:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-03b7ed1d-194a-4f39-94d0-07d79264078f tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "a18d4e32-c275-4c65-a9b7-25f32f43c378" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.741s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:36 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:29:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:29:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 18:29:36 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210561.6387947, fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:29:36 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] VM Stopped (Lifecycle Event)
Aug 16 18:29:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6ddd12f0-5da6-4cc6-b6e5-3a4f40b9a873 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:29:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6ddd12f0-5da6-4cc6-b6e5-3a4f40b9a873 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:29:36 user nova-compute[72000]: INFO nova.compute.manager [None req-6ddd12f0-5da6-4cc6-b6e5-3a4f40b9a873 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 18:29:37 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:29:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:37 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:29:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:29:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:38 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:29:38 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:29:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8535MB free_disk=23.661357879638672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Applying migration context for instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 as it has an incoming, in-progress migration 50506fd1-d8b7-4f38-9322-971726e704d3. Migration status is post-migrating {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 18:29:38 user nova-compute[72000]: INFO nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating resource usage from migration 50506fd1-d8b7-4f38-9322-971726e704d3
Aug 16 18:29:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Migration 50506fd1-d8b7-4f38-9322-971726e704d3 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:29:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:29:39 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:29:39 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:29:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:29:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:29:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:40 user nova-compute[72000]: INFO nova.compute.manager [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attaching volume e44c612b-2f49-402a-9db0-c2a396ac1981 to /dev/vdb
Aug 16 18:29:40 user nova-compute[72000]: DEBUG os_brick.utils [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a1f223-32c5-48a8-a31c-96da4512353c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af296c8-9e32-4097-867e-921d320ca47f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c06556-24d6-4cbd-93a4-7595c757838d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d00272-9548-4a39-b959-9d6f520b30d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:29:40 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:29:40 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e61781f-0599-4150-9d98-c5c04b9b5050]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG os_brick.utils [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:29:40 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating existing volume attachment record: 8df59a1a-7a86-4004-9237-f98d8ff98d6f {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:29:41 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:29:41 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:29:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:29:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Starting finish_migration {{(pid=72000) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Instance directory exists: not creating {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 18:29:44 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Creating image(s)
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Ensure instance console log exists: /opt/stack/data/nova/instances/fa44ba0e-28c7-4915-8cd0-51fe06eb35f5/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Start _get_guest_xml network_info=[{"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1043406858-network", "vif_mac": "fa:16:3e:e0:ae:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqIKlrNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'fa44ba0e-28c7-4915-8cd0-51fe06eb35f5', 'attached_at': '2023-08-16T18:29:45.000000', 'detached_at': '', 'volume_id': 'de0fdb83-e5af-4c05-ba33-702de76f79ca', 'serial': 'de0fdb83-e5af-4c05-ba33-702de76f79ca'}, 'attachment_id': '8b083ebc-c06d-48f8-b0a8-d2cf4f66e95d', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:29:44 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:29:44 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.objects.instance [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqIKlrNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:29:44 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:29:44 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:29:44 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f11d30b-4de2-4dc7-829c-5f07dcc86e0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:29:44 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4bb96a-24ee-4f60-81a9-b3b6653aa7cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca] added
Aug 16 18:29:44 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d502a-9696-4259-8446-8e1452244a26]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[638437b8-3fc4-4494-9075-fc1399066123]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zqIKlrNo {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zqIKlrNo" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2fe22e-3f96-4f2d-a6c3-cfbe1c4a8c40]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zqIKlrNo'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0482506-73b3-468d-abe8-2274c734ff8c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239e1bf-8232-42c8-838f-0c9d23aac8a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:29:44 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:29:44 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:29:44 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:29:44 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 18:29:44 user nova-compute[72000]: 
Aug 16 18:29:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a230b6a-bd52-4853-a549-8f0b3b2e8a40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260]
Aug 16 18:29:45 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260] successful.
Aug 16 18:29:45 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dd2976-924a-4593-b86d-b79e8ce53fc7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff3d34d-191a-4827-b12c-86b3426d06c8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:29:45 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:29:45 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fa872e-1a75-4da0-abdb-7e7dc01a5d1d]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:29:45 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqIKlrNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26236616261636232', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236616261636232', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-306406182',display_name='tempest-ServerActionsTestOtherA-server-306406182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-306406182',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOboTwX+yPl3Cog939zVL+RXhe2iURuYdIg/tydSG7rmvgQL9izant50X7bWgjKoD0OObZiShgjaYDVLpgpQ938h9ReyNLR83Wx2HtCoNu1LYpjzQ+Y1Ln/EOXdF1uY+1g==',key_name='tempest-keypair-1361855606',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:27:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-ieyg58ue',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=fa44ba0e-28c7-4915-8cd0-51fe06eb35f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1043406858-network", "vif_mac": "fa:16:3e:e0:ae:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1043406858-network", "vif_mac": "fa:16:3e:e0:ae:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:29:46 user nova-compute[72000]:   <uuid>fa44ba0e-28c7-4915-8cd0-51fe06eb35f5</uuid>
Aug 16 18:29:46 user nova-compute[72000]:   <name>instance-00000028</name>
Aug 16 18:29:46 user nova-compute[72000]:   <memory>2097152</memory>
Aug 16 18:29:46 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:29:46 user nova-compute[72000]:   <metadata>
Aug 16 18:29:46 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:29:46 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:29:46 user nova-compute[72000]:       <nova:name>tempest-ServerActionsTestOtherA-server-306406182</nova:name>
Aug 16 18:29:46 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:29:44</nova:creationTime>
Aug 16 18:29:46 user nova-compute[72000]:       <nova:flavor name="m1.small">
Aug 16 18:29:46 user nova-compute[72000]:         <nova:memory>2048</nova:memory>
Aug 16 18:29:46 user nova-compute[72000]:         <nova:disk>20</nova:disk>
Aug 16 18:29:46 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:29:46 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:29:46 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:29:46 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:29:46 user nova-compute[72000]:       <nova:owner>
Aug 16 18:29:46 user nova-compute[72000]:         <nova:user uuid="fb9c67db30d3443eaf28670635863118">tempest-ServerActionsTestOtherA-1630250690-project-member</nova:user>
Aug 16 18:29:46 user nova-compute[72000]:         <nova:project uuid="72c4769a48b847f994e32e7c01bd39e0">tempest-ServerActionsTestOtherA-1630250690</nova:project>
Aug 16 18:29:46 user nova-compute[72000]:       </nova:owner>
Aug 16 18:29:46 user nova-compute[72000]:       <nova:ports>
Aug 16 18:29:46 user nova-compute[72000]:         <nova:port uuid="46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9">
Aug 16 18:29:46 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 18:29:46 user nova-compute[72000]:         </nova:port>
Aug 16 18:29:46 user nova-compute[72000]:       </nova:ports>
Aug 16 18:29:46 user nova-compute[72000]:     </nova:instance>
Aug 16 18:29:46 user nova-compute[72000]:   </metadata>
Aug 16 18:29:46 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:29:46 user nova-compute[72000]:     <system>
Aug 16 18:29:46 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:29:46 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:29:46 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:29:46 user nova-compute[72000]:       <entry name="serial">fa44ba0e-28c7-4915-8cd0-51fe06eb35f5</entry>
Aug 16 18:29:46 user nova-compute[72000]:       <entry name="uuid">fa44ba0e-28c7-4915-8cd0-51fe06eb35f5</entry>
Aug 16 18:29:46 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:29:46 user nova-compute[72000]:     </system>
Aug 16 18:29:46 user nova-compute[72000]:   </sysinfo>
Aug 16 18:29:46 user nova-compute[72000]:   <os>
Aug 16 18:29:46 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:29:46 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:29:46 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:29:46 user nova-compute[72000]:   </os>
Aug 16 18:29:46 user nova-compute[72000]:   <features>
Aug 16 18:29:46 user nova-compute[72000]:     <acpi/>
Aug 16 18:29:46 user nova-compute[72000]:     <apic/>
Aug 16 18:29:46 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:29:46 user nova-compute[72000]:   </features>
Aug 16 18:29:46 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:29:46 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:29:46 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:29:46 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:29:46 user nova-compute[72000]:   </clock>
Aug 16 18:29:46 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:29:46 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:29:46 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:29:46 user nova-compute[72000]:   </cpu>
Aug 16 18:29:46 user nova-compute[72000]:   <devices>
Aug 16 18:29:46 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:29:46 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:29:46 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 18:29:46 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:29:46 user nova-compute[72000]:       <serial>de0fdb83-e5af-4c05-ba33-702de76f79ca</serial>
Aug 16 18:29:46 user nova-compute[72000]:     </disk>
Aug 16 18:29:46 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:29:46 user nova-compute[72000]:       <mac address="fa:16:3e:e0:ae:d6"/>
Aug 16 18:29:46 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:29:46 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:29:46 user nova-compute[72000]:       <target dev="tap46b8ec4a-9d"/>
Aug 16 18:29:46 user nova-compute[72000]:     </interface>
Aug 16 18:29:46 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:29:46 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/fa44ba0e-28c7-4915-8cd0-51fe06eb35f5/console.log" append="off"/>
Aug 16 18:29:46 user nova-compute[72000]:     </serial>
Aug 16 18:29:46 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:29:46 user nova-compute[72000]:     <video>
Aug 16 18:29:46 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:29:46 user nova-compute[72000]:     </video>
Aug 16 18:29:46 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:29:46 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:29:46 user nova-compute[72000]:     </rng>
Aug 16 18:29:46 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:29:46 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:29:46 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:29:46 user nova-compute[72000]:     </memballoon>
Aug 16 18:29:46 user nova-compute[72000]:   </devices>
Aug 16 18:29:46 user nova-compute[72000]: </domain>
Aug 16 18:29:46 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-306406182',display_name='tempest-ServerActionsTestOtherA-server-306406182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-306406182',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOboTwX+yPl3Cog939zVL+RXhe2iURuYdIg/tydSG7rmvgQL9izant50X7bWgjKoD0OObZiShgjaYDVLpgpQ938h9ReyNLR83Wx2HtCoNu1LYpjzQ+Y1Ln/EOXdF1uY+1g==',key_name='tempest-keypair-1361855606',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:27:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-ieyg58ue',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=fa44ba0e-28c7-4915-8cd0-51fe06eb35f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1043406858-network", "vif_mac": "fa:16:3e:e0:ae:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1043406858-network", "vif_mac": "fa:16:3e:e0:ae:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG os_vif [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46b8ec4a-9d, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46b8ec4a-9d, col_values=(('external_ids', {'iface-id': '46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:ae:d6', 'vm-uuid': 'fa44ba0e-28c7-4915-8cd0-51fe06eb35f5'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:46 user nova-compute[72000]: INFO os_vif [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d')
Aug 16 18:29:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] No VIF found with MAC fa:16:3e:e0:ae:d6, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:29:46 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:29:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:47 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210572.7755795, a18d4e32-c275-4c65-a9b7-25f32f43c378 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:29:47 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] VM Stopped (Lifecycle Event)
Aug 16 18:29:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-f977659e-481e-4549-879b-8e1872e56507 req-69477fe0-1e32-4371-a1ae-a03a5793f031 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f977659e-481e-4549-879b-8e1872e56507 req-69477fe0-1e32-4371-a1ae-a03a5793f031 service nova] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f977659e-481e-4549-879b-8e1872e56507 req-69477fe0-1e32-4371-a1ae-a03a5793f031 service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f977659e-481e-4549-879b-8e1872e56507 req-69477fe0-1e32-4371-a1ae-a03a5793f031 service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-f977659e-481e-4549-879b-8e1872e56507 req-69477fe0-1e32-4371-a1ae-a03a5793f031 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] No waiting events found dispatching network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:29:47 user nova-compute[72000]: WARNING nova.compute.manager [req-f977659e-481e-4549-879b-8e1872e56507 req-69477fe0-1e32-4371-a1ae-a03a5793f031 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received unexpected event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 for instance with vm_state active and task_state resize_finish.
Aug 16 18:29:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-327862a9-8caa-4d9e-b60d-03f617aa3f57 None None] [instance: a18d4e32-c275-4c65-a9b7-25f32f43c378] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:29:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210589.7944975, fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:29:49 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] VM Resumed (Lifecycle Event)
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:29:49 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Instance running successfully.
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Failed to set time: agent not configured {{(pid=72000) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-69f50c46-ffd9-4e78-b5fd-ceb81988961b tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] finish_migration finished successfully. {{(pid=72000) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:29:49 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210589.796312, fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:29:49 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] VM Started (Lifecycle Event)
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.compute.manager [req-67df8ff2-eb4e-4a74-ace2-00aeeeb57e03 req-92b77e14-1488-46a5-b8e8-0dd38612cf2a service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:29:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-67df8ff2-eb4e-4a74-ace2-00aeeeb57e03 req-92b77e14-1488-46a5-b8e8-0dd38612cf2a service nova] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-67df8ff2-eb4e-4a74-ace2-00aeeeb57e03 req-92b77e14-1488-46a5-b8e8-0dd38612cf2a service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-67df8ff2-eb4e-4a74-ace2-00aeeeb57e03 req-92b77e14-1488-46a5-b8e8-0dd38612cf2a service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.compute.manager [req-67df8ff2-eb4e-4a74-ace2-00aeeeb57e03 req-92b77e14-1488-46a5-b8e8-0dd38612cf2a service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] No waiting events found dispatching network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:29:49 user nova-compute[72000]: WARNING nova.compute.manager [req-67df8ff2-eb4e-4a74-ace2-00aeeeb57e03 req-92b77e14-1488-46a5-b8e8-0dd38612cf2a service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received unexpected event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 for instance with vm_state active and task_state resize_finish.
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:29:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:29:49 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 16 18:29:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNoHdLhB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:29:51 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:29:51 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:29:51 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5b063c-f760-449f-a2d3-26f2de1eb7b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:29:51 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50779dde-45c5-4db4-a18a-63fb4a25b62a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981] added
Aug 16 18:29:51 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5726055-d768-42fd-8f54-d99c08d3d7b6]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e470c2a-d236-4486-becb-c38de7987e92]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bNoHdLhB {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bNoHdLhB" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7847d6be-69f5-4bb8-9990-b028d1d021d4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bNoHdLhB'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0601e4a4-d60b-4282-af07-2b44d9752518]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b498404-5bd9-4dd0-98ea-271ca2323fa6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:29:51 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:29:51 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf95f23-17d9-47bb-9423-545044db0dcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981, portal: 172.16.0.220,3260]
Aug 16 18:29:51 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981, portal: 172.16.0.220,3260] successful.
Aug 16 18:29:51 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3965fcd-c542-4bab-b989-bf94d6f127f7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e1b566-589a-40a7-b95e-2d65333626e9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:29:51 user nova-compute[72000]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 (non-flash)
Aug 16 18:29:51 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:29:51 user nova-compute[72000]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 (non-flash)
Aug 16 18:29:51 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[864d486f-6bf5-487c-a353-690ad2c9d751]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:29:51 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNoHdLhB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:29:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:29:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26538323535356136', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:29:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538323535356136', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:29:52 user nova-compute[72000]: DEBUG nova.objects.instance [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:29:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:29:52 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:29:52 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:29:52 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:29:52 user nova-compute[72000]:   <serial>e44c612b-2f49-402a-9db0-c2a396ac1981</serial>
Aug 16 18:29:52 user nova-compute[72000]: </disk>
Aug 16 18:29:52 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:29:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:29:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:29:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No VIF found with MAC fa:16:3e:b9:98:bd, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:29:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-eb0ff1de-48bd-4dfb-944b-b70486752f3c tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.859s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:29:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:29:55 user nova-compute[72000]: INFO nova.compute.manager [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Detaching volume e44c612b-2f49-402a-9db0-c2a396ac1981
Aug 16 18:29:55 user nova-compute[72000]: INFO nova.virt.block_device [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attempting to driver detach volume e44c612b-2f49-402a-9db0-c2a396ac1981 from mountpoint /dev/vdb
Aug 16 18:29:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Attempting to detach device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:29:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:29:55 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:29:55 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:29:55 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:29:55 user nova-compute[72000]:   <serial>e44c612b-2f49-402a-9db0-c2a396ac1981</serial>
Aug 16 18:29:55 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:29:55 user nova-compute[72000]: </disk>
Aug 16 18:29:55 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:29:55 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Successfully detached device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the persistent domain config.
Aug 16 18:29:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:29:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:29:55 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:29:55 user nova-compute[72000]:   <source dev="/dev/sdc"/>
Aug 16 18:29:55 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:29:55 user nova-compute[72000]:   <serial>e44c612b-2f49-402a-9db0-c2a396ac1981</serial>
Aug 16 18:29:55 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:29:55 user nova-compute[72000]: </disk>
Aug 16 18:29:55 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692210596.2399278, 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:29:56 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Successfully detached device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the live domain config.
Aug 16 18:29:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bNoHdLhB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:29:56 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[94355aae-77b0-4b6c-97c2-600ecd993a3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf23945-702a-4215-9363-ee5e2cf75c88]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:29:56 user nova-compute[72000]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 (non-flash)
Aug 16 18:29:56 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:29:56 user nova-compute[72000]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 (non-flash)
Aug 16 18:29:56 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd010493490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239a47b-080b-4491-b49d-63f31215a3b2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc1c964-05ce-4331-954d-367a4586edac]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[df188294-f9f0-4c15-a3d0-253b47ddb130]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a892ea-460f-4e61-95ef-4d590a7fcb8a]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f915fba-5853-464b-839d-7fbde482ecf5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d3c216-de0f-4c99-ae84-4373b2a378bb]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981, portal: 172.16.0.220,3260]
Aug 16 18:29:56 user nova-compute[72000]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981, portal: 172.16.0.220,3260] successful.
Aug 16 18:29:56 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e44c612b-2f49-402a-9db0-c2a396ac1981 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c28d26-4b76-4bc6-8886-b48af3f559dc]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== disconnect_volume: return (272ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:29:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:29:57 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:29:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f659bd47-ba66-4de8-855f-ff111956b282 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:29:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:30:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:30:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:30:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:30:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:30:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:32 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:30:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:30:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:30:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:30:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "9676d45d-f44d-40b5-9793-4281b9aea0cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:30:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:30:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:30:36 user nova-compute[72000]: INFO nova.compute.claims [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Claim successful on node user
Aug 16 18:30:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG nova.network.neutron [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:30:36 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:30:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:30:36 user nova-compute[72000]: INFO nova.virt.block_device [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Booting with volume f979fa74-d153-4197-bbeb-8703dbcbaee9 at /dev/vda
Aug 16 18:30:36 user nova-compute[72000]: DEBUG nova.policy [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1107151852b84f3185157fff0c0f3495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b758c455ec774042967fb617787c1cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG os_brick.utils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[058cc539-2956-4b3f-97ad-102d6164f1bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5555534f-fc48-4fd1-ab22-392344761b86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc58378-b756-4d0d-b0d9-96d2cf1a93dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd939734-414d-4e1d-8a9e-79f1bbe52f13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:30:36 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:30:36 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5256c4df-6ccc-460d-9945-6c34f9399850]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG os_brick.utils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:30:36 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Updating existing volume attachment record: 094c3cc3-2d1b-44c2-b54f-6d62c7bbefbe {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:30:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Successfully created port: 7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:30:37 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:30:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:30:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:30:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Skipping network cache update for instance because it is Building. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 16 18:30:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:30:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:30:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:30:37 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Successfully updated port: 7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "refresh_cache-9676d45d-f44d-40b5-9793-4281b9aea0cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquired lock "refresh_cache-9676d45d-f44d-40b5-9793-4281b9aea0cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-7eff368c-1f08-42d0-ba1d-6461b9aa15e9 req-4b4a0ff6-0049-4369-a19b-64c3a5d3048b service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received event network-changed-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-7eff368c-1f08-42d0-ba1d-6461b9aa15e9 req-4b4a0ff6-0049-4369-a19b-64c3a5d3048b service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Refreshing instance network info cache due to event network-changed-7cc39601-6bdf-486b-85a1-693e79d4689d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7eff368c-1f08-42d0-ba1d-6461b9aa15e9 req-4b4a0ff6-0049-4369-a19b-64c3a5d3048b service nova] Acquiring lock "refresh_cache-9676d45d-f44d-40b5-9793-4281b9aea0cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Updating instance_info_cache with network_info: [{"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Releasing lock "refresh_cache-9676d45d-f44d-40b5-9793-4281b9aea0cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Instance network_info: |[{"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7eff368c-1f08-42d0-ba1d-6461b9aa15e9 req-4b4a0ff6-0049-4369-a19b-64c3a5d3048b service nova] Acquired lock "refresh_cache-9676d45d-f44d-40b5-9793-4281b9aea0cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG nova.network.neutron [req-7eff368c-1f08-42d0-ba1d-6461b9aa15e9 req-4b4a0ff6-0049-4369-a19b-64c3a5d3048b service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Refreshing network info cache for port 7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:39 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:30:39 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8381MB free_disk=23.657569885253906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.network.neutron [req-7eff368c-1f08-42d0-ba1d-6461b9aa15e9 req-4b4a0ff6-0049-4369-a19b-64c3a5d3048b service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Updated VIF entry in instance network info cache for port 7cc39601-6bdf-486b-85a1-693e79d4689d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.network.neutron [req-7eff368c-1f08-42d0-ba1d-6461b9aa15e9 req-4b4a0ff6-0049-4369-a19b-64c3a5d3048b service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Updating instance_info_cache with network_info: [{"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Applying migration context for instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 as it has an incoming, in-progress migration 50506fd1-d8b7-4f38-9322-971726e704d3. Migration status is finished {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 16 18:30:39 user nova-compute[72000]: INFO nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating resource usage from migration 50506fd1-d8b7-4f38-9322-971726e704d3
Aug 16 18:30:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7eff368c-1f08-42d0-ba1d-6461b9aa15e9 req-4b4a0ff6-0049-4369-a19b-64c3a5d3048b service nova] Releasing lock "refresh_cache-9676d45d-f44d-40b5-9793-4281b9aea0cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Migration 50506fd1-d8b7-4f38-9322-971726e704d3 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 9676d45d-f44d-40b5-9793-4281b9aea0cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:30:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:30:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:30:42 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:30:42 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:30:42 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:30:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:30:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:30:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:30:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:30:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:30:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:30:46 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:30:47 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Creating image(s)
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Ensure instance console log exists: /opt/stack/data/nova/instances/9676d45d-f44d-40b5-9793-4281b9aea0cd/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Start _get_guest_xml network_info=[{"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCirloQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9676d45d-f44d-40b5-9793-4281b9aea0cd', 'attached_at': '', 'detached_at': '', 'volume_id': 'f979fa74-d153-4197-bbeb-8703dbcbaee9', 'serial': 'f979fa74-d153-4197-bbeb-8703dbcbaee9'}, 'attachment_id': '094c3cc3-2d1b-44c2-b54f-6d62c7bbefbe', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:30:47 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:30:47 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCirloQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:30:47 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:30:47 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:30:47 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[703ae5e7-6fd7-4571-a90b-110cf834ee2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:30:47 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bde04c-68c0-49a3-8830-d769197368b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9] added
Aug 16 18:30:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cf39af-968c-46b2-9bb5-cb66491c1136]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b29b1e-5075-4d12-a7f1-194839888c21]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TCirloQw {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TCirloQw" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b6bf44-77c9-4baf-a8db-1ffe75871bd8]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TCirloQw'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[10884d60-59f6-46a9-93f2-abf32a2438e0]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cecafa-8ed4-494e-81dc-b5e800bc2ff5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:30:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:30:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea58eca-3897-45fe-ac6b-63addc3f462d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260]
Aug 16 18:30:47 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260] successful.
Aug 16 18:30:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6823b6ee-d658-41a5-834d-a29a57a73e08]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[141c3c67-5843-43bc-8e8e-0e2e60c4a40d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:30:47 user nova-compute[72000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:30:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:30:47 user nova-compute[72000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:30:47 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b897af-4471-44a5-8249-298fb99c48c7]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:30:47 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCirloQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23437626438303562', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437626438303562', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:30:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-488282508',display_name='tempest-TestVolumeBootPattern-server-488282508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-488282508',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeH+TllNmCaPuNZ7ZDpdAZ2U1yxhHMIwYWH0or6u0ayqmt4OfmsSY6sfiU9gIn1F/l5zMGgKThIwo23xAxIFCcQn4sdo8OhcvXWf8ZZRA2WVCiWVqY2ogTDLbuarVcb+A==',key_name='tempest-TestVolumeBootPattern-1231120149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-b1xbm75w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:30:36Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=9676d45d-f44d-40b5-9793-4281b9aea0cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:bb:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cc39601-6bdf-486b-85a1-693e79d4689d,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc39601-6b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.objects.instance [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'pci_devices' on Instance uuid 9676d45d-f44d-40b5-9793-4281b9aea0cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:30:48 user nova-compute[72000]:   <uuid>9676d45d-f44d-40b5-9793-4281b9aea0cd</uuid>
Aug 16 18:30:48 user nova-compute[72000]:   <name>instance-00000029</name>
Aug 16 18:30:48 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:30:48 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:30:48 user nova-compute[72000]:   <metadata>
Aug 16 18:30:48 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:30:48 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:30:48 user nova-compute[72000]:       <nova:name>tempest-TestVolumeBootPattern-server-488282508</nova:name>
Aug 16 18:30:48 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:30:47</nova:creationTime>
Aug 16 18:30:48 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:30:48 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:30:48 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:30:48 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:30:48 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:30:48 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:30:48 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:30:48 user nova-compute[72000]:       <nova:owner>
Aug 16 18:30:48 user nova-compute[72000]:         <nova:user uuid="1107151852b84f3185157fff0c0f3495">tempest-TestVolumeBootPattern-109968882-project-member</nova:user>
Aug 16 18:30:48 user nova-compute[72000]:         <nova:project uuid="b758c455ec774042967fb617787c1cbd">tempest-TestVolumeBootPattern-109968882</nova:project>
Aug 16 18:30:48 user nova-compute[72000]:       </nova:owner>
Aug 16 18:30:48 user nova-compute[72000]:       <nova:ports>
Aug 16 18:30:48 user nova-compute[72000]:         <nova:port uuid="7cc39601-6bdf-486b-85a1-693e79d4689d">
Aug 16 18:30:48 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 16 18:30:48 user nova-compute[72000]:         </nova:port>
Aug 16 18:30:48 user nova-compute[72000]:       </nova:ports>
Aug 16 18:30:48 user nova-compute[72000]:     </nova:instance>
Aug 16 18:30:48 user nova-compute[72000]:   </metadata>
Aug 16 18:30:48 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:30:48 user nova-compute[72000]:     <system>
Aug 16 18:30:48 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:30:48 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:30:48 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:30:48 user nova-compute[72000]:       <entry name="serial">9676d45d-f44d-40b5-9793-4281b9aea0cd</entry>
Aug 16 18:30:48 user nova-compute[72000]:       <entry name="uuid">9676d45d-f44d-40b5-9793-4281b9aea0cd</entry>
Aug 16 18:30:48 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:30:48 user nova-compute[72000]:     </system>
Aug 16 18:30:48 user nova-compute[72000]:   </sysinfo>
Aug 16 18:30:48 user nova-compute[72000]:   <os>
Aug 16 18:30:48 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:30:48 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:30:48 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:30:48 user nova-compute[72000]:   </os>
Aug 16 18:30:48 user nova-compute[72000]:   <features>
Aug 16 18:30:48 user nova-compute[72000]:     <acpi/>
Aug 16 18:30:48 user nova-compute[72000]:     <apic/>
Aug 16 18:30:48 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:30:48 user nova-compute[72000]:   </features>
Aug 16 18:30:48 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:30:48 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:30:48 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:30:48 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:30:48 user nova-compute[72000]:   </clock>
Aug 16 18:30:48 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:30:48 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:30:48 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:30:48 user nova-compute[72000]:   </cpu>
Aug 16 18:30:48 user nova-compute[72000]:   <devices>
Aug 16 18:30:48 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:30:48 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:30:48 user nova-compute[72000]:       <source dev="/dev/sdc"/>
Aug 16 18:30:48 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:30:48 user nova-compute[72000]:       <serial>f979fa74-d153-4197-bbeb-8703dbcbaee9</serial>
Aug 16 18:30:48 user nova-compute[72000]:     </disk>
Aug 16 18:30:48 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:30:48 user nova-compute[72000]:       <mac address="fa:16:3e:59:bb:2b"/>
Aug 16 18:30:48 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:30:48 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:30:48 user nova-compute[72000]:       <target dev="tap7cc39601-6b"/>
Aug 16 18:30:48 user nova-compute[72000]:     </interface>
Aug 16 18:30:48 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:30:48 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/9676d45d-f44d-40b5-9793-4281b9aea0cd/console.log" append="off"/>
Aug 16 18:30:48 user nova-compute[72000]:     </serial>
Aug 16 18:30:48 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:30:48 user nova-compute[72000]:     <video>
Aug 16 18:30:48 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:30:48 user nova-compute[72000]:     </video>
Aug 16 18:30:48 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:30:48 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:30:48 user nova-compute[72000]:     </rng>
Aug 16 18:30:48 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:30:48 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:30:48 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:30:48 user nova-compute[72000]:     </memballoon>
Aug 16 18:30:48 user nova-compute[72000]:   </devices>
Aug 16 18:30:48 user nova-compute[72000]: </domain>
Aug 16 18:30:48 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:30:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-488282508',display_name='tempest-TestVolumeBootPattern-server-488282508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-488282508',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeH+TllNmCaPuNZ7ZDpdAZ2U1yxhHMIwYWH0or6u0ayqmt4OfmsSY6sfiU9gIn1F/l5zMGgKThIwo23xAxIFCcQn4sdo8OhcvXWf8ZZRA2WVCiWVqY2ogTDLbuarVcb+A==',key_name='tempest-TestVolumeBootPattern-1231120149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-b1xbm75w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:30:36Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=9676d45d-f44d-40b5-9793-4281b9aea0cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:bb:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cc39601-6bdf-486b-85a1-693e79d4689d,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc39601-6b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG os_vif [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:bb:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cc39601-6bdf-486b-85a1-693e79d4689d,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc39601-6b') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cc39601-6b, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cc39601-6b, col_values=(('external_ids', {'iface-id': '7cc39601-6bdf-486b-85a1-693e79d4689d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:bb:2b', 'vm-uuid': '9676d45d-f44d-40b5-9793-4281b9aea0cd'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:48 user nova-compute[72000]: INFO os_vif [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:bb:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cc39601-6bdf-486b-85a1-693e79d4689d,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc39601-6b')
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:30:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No VIF found with MAC fa:16:3e:59:bb:2b, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:30:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:30:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:30:49 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:30:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:30:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:30:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:30:49 user nova-compute[72000]: INFO nova.compute.manager [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attaching volume d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c to /dev/vdb
Aug 16 18:30:50 user nova-compute[72000]: DEBUG os_brick.utils [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3491bda-217d-441f-b277-f51b8a10c4f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[edab8002-b612-4fbc-bbf8-50bb66d7abaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5829e3ab-dc00-45fb-91ce-dcac4321adb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0c72a9-d19a-4767-b906-e1b0626f5291]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:30:50 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[43177bd0-1a1a-49e7-bbd4-61b9b8297772]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG os_brick.utils [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating existing volume attachment record: 5aec4896-3632-4d13-8bae-6683baa3c035 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-4ea46be4-b9a4-49f8-b708-ad57469917ad req-eddf4d5e-774b-4a32-989a-aae3a5a219e1 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received event network-vif-plugged-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4ea46be4-b9a4-49f8-b708-ad57469917ad req-eddf4d5e-774b-4a32-989a-aae3a5a219e1 service nova] Acquiring lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4ea46be4-b9a4-49f8-b708-ad57469917ad req-eddf4d5e-774b-4a32-989a-aae3a5a219e1 service nova] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4ea46be4-b9a4-49f8-b708-ad57469917ad req-eddf4d5e-774b-4a32-989a-aae3a5a219e1 service nova] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-4ea46be4-b9a4-49f8-b708-ad57469917ad req-eddf4d5e-774b-4a32-989a-aae3a5a219e1 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] No waiting events found dispatching network-vif-plugged-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:30:50 user nova-compute[72000]: WARNING nova.compute.manager [req-4ea46be4-b9a4-49f8-b708-ad57469917ad req-eddf4d5e-774b-4a32-989a-aae3a5a219e1 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received unexpected event network-vif-plugged-7cc39601-6bdf-486b-85a1-693e79d4689d for instance with vm_state building and task_state spawning.
Aug 16 18:30:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-ca9e9df9-2478-4c28-a185-7359880083ca req-41b7b5e3-3515-4c44-a618-0026760e3dcc service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received event network-vif-plugged-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ca9e9df9-2478-4c28-a185-7359880083ca req-41b7b5e3-3515-4c44-a618-0026760e3dcc service nova] Acquiring lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ca9e9df9-2478-4c28-a185-7359880083ca req-41b7b5e3-3515-4c44-a618-0026760e3dcc service nova] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ca9e9df9-2478-4c28-a185-7359880083ca req-41b7b5e3-3515-4c44-a618-0026760e3dcc service nova] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-ca9e9df9-2478-4c28-a185-7359880083ca req-41b7b5e3-3515-4c44-a618-0026760e3dcc service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] No waiting events found dispatching network-vif-plugged-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:30:52 user nova-compute[72000]: WARNING nova.compute.manager [req-ca9e9df9-2478-4c28-a185-7359880083ca req-41b7b5e3-3515-4c44-a618-0026760e3dcc service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received unexpected event network-vif-plugged-7cc39601-6bdf-486b-85a1-693e79d4689d for instance with vm_state building and task_state spawning.
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210652.4104393, 9676d45d-f44d-40b5-9793-4281b9aea0cd => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:30:52 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] VM Resumed (Lifecycle Event)
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:30:52 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Instance spawned successfully.
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:30:52 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210652.416085, 9676d45d-f44d-40b5-9793-4281b9aea0cd => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:30:52 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] VM Started (Lifecycle Event)
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:30:52 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:30:52 user nova-compute[72000]: INFO nova.compute.manager [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Took 5.21 seconds to spawn the instance on the hypervisor.
Aug 16 18:30:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:30:52 user nova-compute[72000]: INFO nova.compute.manager [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Took 16.60 seconds to build instance.
Aug 16 18:30:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-2d329002-9741-41fc-9fe6-e5fabe017279 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.753s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:30:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:30:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RIwyunsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:31:01 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:31:01 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:31:01 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[540d12e9-bd03-41cc-b952-418e1e5feb39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:31:01 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc208353-b689-479e-bd74-4bd31c19a0bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c] added
Aug 16 18:31:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[891640ff-ebfc-4308-a147-715a2bc68295]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8e8c3f-5a03-4312-947d-794e6c769c44]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RIwyunsl {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RIwyunsl" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c4eb79-1ae3-4aae-8e9c-464e33b18d26]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RIwyunsl'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d045cb-5190-4a2d-bedd-0ea6e45b2280]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a2792f-79ee-42c9-9813-c4485d478780]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:31:01 user nova-compute[72000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:31:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:31:01 user nova-compute[72000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:31:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd213f0-0f63-4467-9b92-b9f47736b65b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c, portal: 172.16.0.220,3260]
Aug 16 18:31:01 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c, portal: 172.16.0.220,3260] successful.
Aug 16 18:31:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0be4cb-c097-43b8-81be-bd1ef4ef7bf5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3097f0-6c43-4e27-b903-a828aa055ac5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:31:01 user nova-compute[72000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:31:01 user nova-compute[72000]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c (non-flash)
Aug 16 18:31:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:31:01 user nova-compute[72000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:31:01 user nova-compute[72000]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c (non-flash)
Aug 16 18:31:01 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[da47b82a-1f27-43ad-9381-0e2dc6594838]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:01 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:31:02 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:31:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RIwyunsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:31:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:31:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23666613262373236', 'path': '/dev/sdd'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:31:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666613262373236', 'path': '/dev/sdd'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:31:02 user nova-compute[72000]: DEBUG nova.objects.instance [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:31:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 18:31:02 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:31:02 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:31:02 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:31:02 user nova-compute[72000]:   <serial>d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c</serial>
Aug 16 18:31:02 user nova-compute[72000]: </disk>
Aug 16 18:31:02 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 18:31:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:31:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:31:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] No VIF found with MAC fa:16:3e:b9:98:bd, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:31:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-a7d00aa9-8c6b-4d15-924f-016f2de5addf tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.353s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:31:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:31:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:31:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:31:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:31:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:31:05 user nova-compute[72000]: INFO nova.compute.manager [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Detaching volume d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c
Aug 16 18:31:05 user nova-compute[72000]: INFO nova.virt.block_device [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Attempting to driver detach volume d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c from mountpoint /dev/vdb
Aug 16 18:31:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Attempting to detach device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 18:31:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:31:05 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:31:05 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:31:05 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:31:05 user nova-compute[72000]:   <serial>d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c</serial>
Aug 16 18:31:05 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:31:05 user nova-compute[72000]: </disk>
Aug 16 18:31:05 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:31:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Successfully detached device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the persistent domain config.
Aug 16 18:31:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 18:31:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 18:31:05 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:31:05 user nova-compute[72000]:   <source dev="/dev/sdd"/>
Aug 16 18:31:05 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 18:31:05 user nova-compute[72000]:   <serial>d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c</serial>
Aug 16 18:31:05 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 18:31:05 user nova-compute[72000]: </disk>
Aug 16 18:31:05 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692210666.0344768, 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 18:31:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Successfully detached device vdb from instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 from the live domain config.
Aug 16 18:31:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RIwyunsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:31:06 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[744d6811-b5a9-4097-89aa-c235bb8b15ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80e7a05-b985-4635-811c-dae670075e3d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:31:06 user nova-compute[72000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:31:06 user nova-compute[72000]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c (non-flash)
Aug 16 18:31:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:31:06 user nova-compute[72000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:31:06 user nova-compute[72000]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c (non-flash)
Aug 16 18:31:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcfe8777490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c'): ({'sdd'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Removing single pathed devices sdd {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d33d1e3-c6a9-44a8-89ce-a1160c5b2f12]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3edce37-562a-4afe-824a-806adac6f587]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Flushing IO for device /dev/sdd {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21a99b8-b9a0-413d-aab3-08c3ccf25e76]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[92909a00-cd2c-41ad-8184-853c2a62f69f]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] SCSI volumes sdd have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f47358-fe6d-4fdc-844c-3980e55e77f5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2f55a7-e397-488b-9992-8747a16c4fb0]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c, portal: 172.16.0.220,3260]
Aug 16 18:31:06 user nova-compute[72000]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c, portal: 172.16.0.220,3260] successful.
Aug 16 18:31:06 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d162f2c0-22ec-4d2e-b3fb-7fb2634f0c1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a09e53-0e78-4df5-92f2-f0bcdb725879]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] <== disconnect_volume: return (285ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:31:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:31:07 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'flavor' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:31:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c0fdc7e4-3a1e-4b31-87c7-23d4d79afc45 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.891s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:31:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:31:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:31:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Going to confirm migration 2 {{(pid=72000) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 16 18:31:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:31:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquired lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:31:09 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:31:09 user nova-compute[72000]: DEBUG nova.objects.instance [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'info_cache' on Instance uuid fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:31:10 user nova-compute[72000]: DEBUG nova.network.neutron [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating instance_info_cache with network_info: [{"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:31:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Releasing lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:31:10 user nova-compute[72000]: DEBUG nova.objects.instance [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'migration_context' on Instance uuid fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:31:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:31:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:31:10 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:31:10 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:31:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.245s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:31:10 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Deleted allocation for migration 50506fd1-d8b7-4f38-9322-971726e704d3
Aug 16 18:31:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-fe7310ea-7c12-459f-9cde-646c9ba1e6e0 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.169s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:31:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:31:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:31:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:31:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:36 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:37 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:31:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:31:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:31:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating instance_info_cache with network_info: [{"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:31:39 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:31:39 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8341MB free_disk=23.654216766357422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 9676d45d-f44d-40b5-9793-4281b9aea0cd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:31:39 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:31:40 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:31:40 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:31:40 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:31:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:31:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:44 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:44 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:31:44 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:31:45 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:31:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:31:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:31:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:31:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:31:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:31:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:31:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:31:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:31:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:31:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:31:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:32:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:32:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:32:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:32:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:32:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:32:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:32:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:32:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:32:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:32:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:32:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:32:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:32:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:32:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:32:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:32:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:32:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-3214fd3d-c5dc-4a54-8cae-ae3d2141cdce req-8765ff4e-59aa-446e-ace6-00a5c45b7a07 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received event network-changed-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:32:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-3214fd3d-c5dc-4a54-8cae-ae3d2141cdce req-8765ff4e-59aa-446e-ace6-00a5c45b7a07 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Refreshing instance network info cache due to event network-changed-7cc39601-6bdf-486b-85a1-693e79d4689d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:32:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3214fd3d-c5dc-4a54-8cae-ae3d2141cdce req-8765ff4e-59aa-446e-ace6-00a5c45b7a07 service nova] Acquiring lock "refresh_cache-9676d45d-f44d-40b5-9793-4281b9aea0cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:32:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3214fd3d-c5dc-4a54-8cae-ae3d2141cdce req-8765ff4e-59aa-446e-ace6-00a5c45b7a07 service nova] Acquired lock "refresh_cache-9676d45d-f44d-40b5-9793-4281b9aea0cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:32:28 user nova-compute[72000]: DEBUG nova.network.neutron [req-3214fd3d-c5dc-4a54-8cae-ae3d2141cdce req-8765ff4e-59aa-446e-ace6-00a5c45b7a07 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Refreshing network info cache for port 7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:32:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "9676d45d-f44d-40b5-9793-4281b9aea0cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:29 user nova-compute[72000]: INFO nova.compute.manager [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Terminating instance
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-3214fd3d-c5dc-4a54-8cae-ae3d2141cdce req-8765ff4e-59aa-446e-ace6-00a5c45b7a07 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Updated VIF entry in instance network info cache for port 7cc39601-6bdf-486b-85a1-693e79d4689d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-3214fd3d-c5dc-4a54-8cae-ae3d2141cdce req-8765ff4e-59aa-446e-ace6-00a5c45b7a07 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Updating instance_info_cache with network_info: [{"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3214fd3d-c5dc-4a54-8cae-ae3d2141cdce req-8765ff4e-59aa-446e-ace6-00a5c45b7a07 service nova] Releasing lock "refresh_cache-9676d45d-f44d-40b5-9793-4281b9aea0cd" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-99367cc4-25a0-4d72-88ed-7a7d15d56cbe req-cfe56c2f-34f4-4cf2-8594-2763d51264d1 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received event network-vif-unplugged-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-99367cc4-25a0-4d72-88ed-7a7d15d56cbe req-cfe56c2f-34f4-4cf2-8594-2763d51264d1 service nova] Acquiring lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-99367cc4-25a0-4d72-88ed-7a7d15d56cbe req-cfe56c2f-34f4-4cf2-8594-2763d51264d1 service nova] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-99367cc4-25a0-4d72-88ed-7a7d15d56cbe req-cfe56c2f-34f4-4cf2-8594-2763d51264d1 service nova] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-99367cc4-25a0-4d72-88ed-7a7d15d56cbe req-cfe56c2f-34f4-4cf2-8594-2763d51264d1 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] No waiting events found dispatching network-vif-unplugged-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-99367cc4-25a0-4d72-88ed-7a7d15d56cbe req-cfe56c2f-34f4-4cf2-8594-2763d51264d1 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received event network-vif-unplugged-7cc39601-6bdf-486b-85a1-693e79d4689d for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:32:29 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Instance destroyed successfully.
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'resources' on Instance uuid 9676d45d-f44d-40b5-9793-4281b9aea0cd {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:30:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-488282508',display_name='tempest-TestVolumeBootPattern-server-488282508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-488282508',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeH+TllNmCaPuNZ7ZDpdAZ2U1yxhHMIwYWH0or6u0ayqmt4OfmsSY6sfiU9gIn1F/l5zMGgKThIwo23xAxIFCcQn4sdo8OhcvXWf8ZZRA2WVCiWVqY2ogTDLbuarVcb+A==',key_name='tempest-TestVolumeBootPattern-1231120149',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:30:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-b1xbm75w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:30:53Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=9676d45d-f44d-40b5-9793-4281b9aea0cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "7cc39601-6bdf-486b-85a1-693e79d4689d", "address": "fa:16:3e:59:bb:2b", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc39601-6b", "ovs_interfaceid": "7cc39601-6bdf-486b-85a1-693e79d4689d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:bb:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cc39601-6bdf-486b-85a1-693e79d4689d,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc39601-6b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG os_vif [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:bb:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cc39601-6bdf-486b-85a1-693e79d4689d,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc39601-6b') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cc39601-6b, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:29 user nova-compute[72000]: INFO os_vif [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:bb:2b,bridge_name='br-int',has_traffic_filtering=True,id=7cc39601-6bdf-486b-85a1-693e79d4689d,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc39601-6b')
Aug 16 18:32:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCirloQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:32:29 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:32:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c5ed26-a58c-47e1-bbc9-7217826a110e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c02ce8-354d-491c-a5d6-08f3776b15e0]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:32:29 user nova-compute[72000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:32:29 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:32:29 user nova-compute[72000]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:32:29 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0082c76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c51959-22f2-4527-a066-0c2009582380]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebb0ded-43e7-4fba-9a7c-9f226fa46b9c]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:29 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2385c7ae-d4ce-4247-94fc-94d24584ac43]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c83669-16a5-4d82-b805-0b484db2610f]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce20952-352f-4b7b-a22e-3495af0b9702]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9622f63-fee4-4c5c-bdfd-145a9fd0d3f0]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260]
Aug 16 18:32:30 user nova-compute[72000]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260] successful.
Aug 16 18:32:30 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[376b9e9c-2d34-48f0-9c35-71878ae3d3c4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== disconnect_volume: return (297ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:32:30 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Deleting instance files /opt/stack/data/nova/instances/9676d45d-f44d-40b5-9793-4281b9aea0cd_del
Aug 16 18:32:30 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Deletion of /opt/stack/data/nova/instances/9676d45d-f44d-40b5-9793-4281b9aea0cd_del complete
Aug 16 18:32:30 user nova-compute[72000]: INFO nova.compute.manager [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 16 18:32:30 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:32:30 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:32:31 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:32:31 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Took 0.94 seconds to deallocate network for instance.
Aug 16 18:32:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-d8cc78cf-9397-43ee-a511-6671ef4427d7 req-189d7aa0-80f6-412b-9a5a-2e9ddeeea039 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received event network-vif-plugged-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:32:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d8cc78cf-9397-43ee-a511-6671ef4427d7 req-189d7aa0-80f6-412b-9a5a-2e9ddeeea039 service nova] Acquiring lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d8cc78cf-9397-43ee-a511-6671ef4427d7 req-189d7aa0-80f6-412b-9a5a-2e9ddeeea039 service nova] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d8cc78cf-9397-43ee-a511-6671ef4427d7 req-189d7aa0-80f6-412b-9a5a-2e9ddeeea039 service nova] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-d8cc78cf-9397-43ee-a511-6671ef4427d7 req-189d7aa0-80f6-412b-9a5a-2e9ddeeea039 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] No waiting events found dispatching network-vif-plugged-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:32:31 user nova-compute[72000]: WARNING nova.compute.manager [req-d8cc78cf-9397-43ee-a511-6671ef4427d7 req-189d7aa0-80f6-412b-9a5a-2e9ddeeea039 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received unexpected event network-vif-plugged-7cc39601-6bdf-486b-85a1-693e79d4689d for instance with vm_state active and task_state deleting.
Aug 16 18:32:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-d8cc78cf-9397-43ee-a511-6671ef4427d7 req-189d7aa0-80f6-412b-9a5a-2e9ddeeea039 service nova] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Received event network-vif-deleted-7cc39601-6bdf-486b-85a1-693e79d4689d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:32:31 user nova-compute[72000]: INFO nova.compute.manager [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 18:32:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:32 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:32:32 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:32:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:32 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Deleted allocations for instance 9676d45d-f44d-40b5-9793-4281b9aea0cd
Aug 16 18:32:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0c35f2f4-93a0-4c61-a04d-cc701f75be8e tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "9676d45d-f44d-40b5-9793-4281b9aea0cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.235s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:32:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:35 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:32:36 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:32:36 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:32:37 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:32:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:32:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:32:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:32:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating instance_info_cache with network_info: [{"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:38 user nova-compute[72000]: INFO nova.compute.manager [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Terminating instance
Aug 16 18:32:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-333f3cdd-b84e-48b4-a453-97cd73a7edff req-fec12b39-f031-4dfd-a9e6-4657905010a8 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received event network-vif-unplugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-333f3cdd-b84e-48b4-a453-97cd73a7edff req-fec12b39-f031-4dfd-a9e6-4657905010a8 service nova] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-333f3cdd-b84e-48b4-a453-97cd73a7edff req-fec12b39-f031-4dfd-a9e6-4657905010a8 service nova] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-333f3cdd-b84e-48b4-a453-97cd73a7edff req-fec12b39-f031-4dfd-a9e6-4657905010a8 service nova] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-333f3cdd-b84e-48b4-a453-97cd73a7edff req-fec12b39-f031-4dfd-a9e6-4657905010a8 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] No waiting events found dispatching network-vif-unplugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-333f3cdd-b84e-48b4-a453-97cd73a7edff req-fec12b39-f031-4dfd-a9e6-4657905010a8 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received event network-vif-unplugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Instance destroyed successfully.
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lazy-loading 'resources' on Instance uuid 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1960269605',display_name='tempest-SnapshotDataIntegrityTests-server-1960269605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1960269605',id=37,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLJbgfhmL0on4Sy4w9JPSiSensAVu4PJViUTj/8IVG5lTBZ32G2crp6bfrmhc2IAEtAugj86ApPqmN7WiNwm7XaDa2X0kLSP3/1eYn1J87d+6edFGlUrLwzHGQ3QTCOoQ==',key_name='tempest-keypair-765710998',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:25:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c9ba43f2dd74a6eab97ebda18fd3616',ramdisk_id='',reservation_id='r-jda144uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-138910526',owner_user_name='tempest-SnapshotDataIntegrityTests-138910526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:25:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16c57230dd674d569c5e30b506575633',uuid=42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Converting VIF {"id": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "address": "fa:16:3e:b9:98:bd", "network": {"id": "320b78ef-65a7-4649-b023-5dc2131c81bc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088220489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c9ba43f2dd74a6eab97ebda18fd3616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e34bbc-d4", "ovs_interfaceid": "11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:98:bd,bridge_name='br-int',has_traffic_filtering=True,id=11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628,network=Network(320b78ef-65a7-4649-b023-5dc2131c81bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e34bbc-d4') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG os_vif [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:98:bd,bridge_name='br-int',has_traffic_filtering=True,id=11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628,network=Network(320b78ef-65a7-4649-b023-5dc2131c81bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e34bbc-d4') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11e34bbc-d4, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:32:39 user nova-compute[72000]: INFO os_vif [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:98:bd,bridge_name='br-int',has_traffic_filtering=True,id=11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628,network=Network(320b78ef-65a7-4649-b023-5dc2131c81bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e34bbc-d4')
Aug 16 18:32:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Deleting instance files /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9_del
Aug 16 18:32:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Deletion of /opt/stack/data/nova/instances/42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9_del complete
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:32:39 user nova-compute[72000]: INFO nova.compute.manager [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-0279d5e6-40e0-4a3c-b633-157a72bc2c50 req-23188ae5-2afb-41a2-8eb4-1859acee8221 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received event network-vif-deleted-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:32:40 user nova-compute[72000]: INFO nova.compute.manager [req-0279d5e6-40e0-4a3c-b633-157a72bc2c50 req-23188ae5-2afb-41a2-8eb4-1859acee8221 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Neutron deleted interface 11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628; detaching it from the instance and deleting it from the info cache
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.network.neutron [req-0279d5e6-40e0-4a3c-b633-157a72bc2c50 req-23188ae5-2afb-41a2-8eb4-1859acee8221 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:32:40 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:32:40 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=23.673145294189453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:40 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Took 0.93 seconds to deallocate network for instance.
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.manager [req-0279d5e6-40e0-4a3c-b633-157a72bc2c50 req-23188ae5-2afb-41a2-8eb4-1859acee8221 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Detach interface failed, port_id=11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628, reason: Instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.177s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:32:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:41 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Deleted allocations for instance 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9
Aug 16 18:32:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-bf5f1dcf-44b5-44b5-80e2-4fe35fe6a72c req-a4c554e0-23e3-489c-8e3e-3b268149df31 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received event network-vif-plugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:32:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bf5f1dcf-44b5-44b5-80e2-4fe35fe6a72c req-a4c554e0-23e3-489c-8e3e-3b268149df31 service nova] Acquiring lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:32:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bf5f1dcf-44b5-44b5-80e2-4fe35fe6a72c req-a4c554e0-23e3-489c-8e3e-3b268149df31 service nova] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:32:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-bf5f1dcf-44b5-44b5-80e2-4fe35fe6a72c req-a4c554e0-23e3-489c-8e3e-3b268149df31 service nova] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-bf5f1dcf-44b5-44b5-80e2-4fe35fe6a72c req-a4c554e0-23e3-489c-8e3e-3b268149df31 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] No waiting events found dispatching network-vif-plugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:32:41 user nova-compute[72000]: WARNING nova.compute.manager [req-bf5f1dcf-44b5-44b5-80e2-4fe35fe6a72c req-a4c554e0-23e3-489c-8e3e-3b268149df31 service nova] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Received unexpected event network-vif-plugged-11e34bbc-d48f-4b07-b8a6-c0e1bd9cb628 for instance with vm_state deleted and task_state None.
Aug 16 18:32:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5bd1bd77-52a9-4044-89fa-80425295b5f9 tempest-SnapshotDataIntegrityTests-138910526 tempest-SnapshotDataIntegrityTests-138910526-project-member] Lock "42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.327s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:32:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:44 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210749.828568, 9676d45d-f44d-40b5-9793-4281b9aea0cd => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:32:44 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] VM Stopped (Lifecycle Event)
Aug 16 18:32:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d3d5e649-31b9-4945-a038-8f4af211f771 None None] [instance: 9676d45d-f44d-40b5-9793-4281b9aea0cd] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:32:45 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:32:46 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:32:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:32:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:32:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:54 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210759.5193121, 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:32:54 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] VM Stopped (Lifecycle Event)
Aug 16 18:32:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-70a5230c-71f0-4718-81ff-266fd148d487 None None] [instance: 42449a39-d2ff-4a58-8b8e-5fb1d8c4d1e9] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:32:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:32:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:33:00 user nova-compute[72000]: INFO nova.compute.manager [None req-2df3441e-e708-4368-bc24-8f9ffc7896db tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Get console output
Aug 16 18:33:01 user nova-compute[72000]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 16 18:33:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:33:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:33:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:33:20 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:33:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:33:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:33:20 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:33:20 user nova-compute[72000]: INFO nova.compute.claims [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Claim successful on node user
Aug 16 18:33:20 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:33:20 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:33:21 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:33:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:33:21 user nova-compute[72000]: INFO nova.virt.block_device [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Booting with volume f979fa74-d153-4197-bbeb-8703dbcbaee9 at /dev/vda
Aug 16 18:33:21 user nova-compute[72000]: DEBUG nova.policy [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1107151852b84f3185157fff0c0f3495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b758c455ec774042967fb617787c1cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG os_brick.utils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[58663c18-7114-4b75-87e6-36635dd2496d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b3fb3-bf1e-4980-b7c9-791f3f25e63d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94e0c78-1f73-4b89-9926-8a266489313e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e524c026-bfc3-4ed6-ae9d-f5e4a4b95867]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:33:21 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:33:21 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847651d-58f7-40e7-a125-ab498f175b5b]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG os_brick.utils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:33:21 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updating existing volume attachment record: 24bd1e45-8492-4caa-aeba-523a7dddc26f {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:33:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Successfully created port: d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:33:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Successfully updated port: d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:33:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:33:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquired lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:33:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:33:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-541d2d7c-6d35-4ccf-9b3b-74769ddc4d76 req-df6f5df2-2b50-4459-9da8-ac4c8a2ff7c2 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received event network-changed-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:33:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-541d2d7c-6d35-4ccf-9b3b-74769ddc4d76 req-df6f5df2-2b50-4459-9da8-ac4c8a2ff7c2 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Refreshing instance network info cache due to event network-changed-d0560bcc-bc28-4729-b76f-d4f4405ef4ab. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:33:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-541d2d7c-6d35-4ccf-9b3b-74769ddc4d76 req-df6f5df2-2b50-4459-9da8-ac4c8a2ff7c2 service nova] Acquiring lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:33:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:33:23 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updating instance_info_cache with network_info: [{"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:33:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Releasing lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:33:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Instance network_info: |[{"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:33:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-541d2d7c-6d35-4ccf-9b3b-74769ddc4d76 req-df6f5df2-2b50-4459-9da8-ac4c8a2ff7c2 service nova] Acquired lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:33:23 user nova-compute[72000]: DEBUG nova.network.neutron [req-541d2d7c-6d35-4ccf-9b3b-74769ddc4d76 req-df6f5df2-2b50-4459-9da8-ac4c8a2ff7c2 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Refreshing network info cache for port d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:33:23 user nova-compute[72000]: DEBUG nova.network.neutron [req-541d2d7c-6d35-4ccf-9b3b-74769ddc4d76 req-df6f5df2-2b50-4459-9da8-ac4c8a2ff7c2 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updated VIF entry in instance network info cache for port d0560bcc-bc28-4729-b76f-d4f4405ef4ab. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:33:23 user nova-compute[72000]: DEBUG nova.network.neutron [req-541d2d7c-6d35-4ccf-9b3b-74769ddc4d76 req-df6f5df2-2b50-4459-9da8-ac4c8a2ff7c2 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updating instance_info_cache with network_info: [{"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:33:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-541d2d7c-6d35-4ccf-9b3b-74769ddc4d76 req-df6f5df2-2b50-4459-9da8-ac4c8a2ff7c2 service nova] Releasing lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:33:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:33:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:33:31 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Creating image(s)
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Ensure instance console log exists: /opt/stack/data/nova/instances/71a87e9f-7705-40a5-9ca7-9aca0bbae678/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Start _get_guest_xml network_info=[{"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCirloQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71a87e9f-7705-40a5-9ca7-9aca0bbae678', 'attached_at': '', 'detached_at': '', 'volume_id': 'f979fa74-d153-4197-bbeb-8703dbcbaee9', 'serial': 'f979fa74-d153-4197-bbeb-8703dbcbaee9'}, 'attachment_id': '24bd1e45-8492-4caa-aeba-523a7dddc26f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:33:31 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:33:31 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCirloQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:33:31 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:33:31 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:33:31 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab08d38-8fa8-456e-aa89-8a6c8971df23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:33:31 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21422a91-19f1-4f64-bff7-8b3a2b90ebb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9] added
Aug 16 18:33:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7369f22a-6e7c-4d86-8492-98ff3627c0de]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a556231e-6d8b-417e-8220-fcc8a8c84d46]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TCirloQw {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TCirloQw" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f7a5e1-c752-4330-875a-99538b3d6667]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TCirloQw'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[694d3ee4-200e-4e9f-bdf4-9d82bab3bf75]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59549935-7530-4c7d-ac4e-27ef629a224a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:33:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:33:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d143f6-6974-4d36-a9cf-d6009bab58ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260]
Aug 16 18:33:31 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260] successful.
Aug 16 18:33:31 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:33:31 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1905ae2d-6068-4d80-8b16-10b500fe6e65]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[765f6e42-8fa1-4ce9-a050-7768faa22815]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:33:32 user nova-compute[72000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:33:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:33:32 user nova-compute[72000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:33:32 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f10f7f-5d64-4a87-925e-7366b21f0310]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCirloQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:33:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23437626438303562', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437626438303562', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-954955042',display_name='tempest-TestVolumeBootPattern-server-954955042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-954955042',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeH+TllNmCaPuNZ7ZDpdAZ2U1yxhHMIwYWH0or6u0ayqmt4OfmsSY6sfiU9gIn1F/l5zMGgKThIwo23xAxIFCcQn4sdo8OhcvXWf8ZZRA2WVCiWVqY2ogTDLbuarVcb+A==',key_name='tempest-TestVolumeBootPattern-1231120149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-y38f5pet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:33:21Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=71a87e9f-7705-40a5-9ca7-9aca0bbae678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:0c:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0560bcc-bc28-4729-b76f-d4f4405ef4ab,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0560bcc-bc') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'pci_devices' on Instance uuid 71a87e9f-7705-40a5-9ca7-9aca0bbae678 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:33:33 user nova-compute[72000]:   <uuid>71a87e9f-7705-40a5-9ca7-9aca0bbae678</uuid>
Aug 16 18:33:33 user nova-compute[72000]:   <name>instance-0000002a</name>
Aug 16 18:33:33 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:33:33 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:33:33 user nova-compute[72000]:   <metadata>
Aug 16 18:33:33 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:33:33 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:33:33 user nova-compute[72000]:       <nova:name>tempest-TestVolumeBootPattern-server-954955042</nova:name>
Aug 16 18:33:33 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:33:31</nova:creationTime>
Aug 16 18:33:33 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:33:33 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:33:33 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:33:33 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:33:33 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:33:33 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:33:33 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:33:33 user nova-compute[72000]:       <nova:owner>
Aug 16 18:33:33 user nova-compute[72000]:         <nova:user uuid="1107151852b84f3185157fff0c0f3495">tempest-TestVolumeBootPattern-109968882-project-member</nova:user>
Aug 16 18:33:33 user nova-compute[72000]:         <nova:project uuid="b758c455ec774042967fb617787c1cbd">tempest-TestVolumeBootPattern-109968882</nova:project>
Aug 16 18:33:33 user nova-compute[72000]:       </nova:owner>
Aug 16 18:33:33 user nova-compute[72000]:       <nova:ports>
Aug 16 18:33:33 user nova-compute[72000]:         <nova:port uuid="d0560bcc-bc28-4729-b76f-d4f4405ef4ab">
Aug 16 18:33:33 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 18:33:33 user nova-compute[72000]:         </nova:port>
Aug 16 18:33:33 user nova-compute[72000]:       </nova:ports>
Aug 16 18:33:33 user nova-compute[72000]:     </nova:instance>
Aug 16 18:33:33 user nova-compute[72000]:   </metadata>
Aug 16 18:33:33 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:33:33 user nova-compute[72000]:     <system>
Aug 16 18:33:33 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:33:33 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:33:33 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:33:33 user nova-compute[72000]:       <entry name="serial">71a87e9f-7705-40a5-9ca7-9aca0bbae678</entry>
Aug 16 18:33:33 user nova-compute[72000]:       <entry name="uuid">71a87e9f-7705-40a5-9ca7-9aca0bbae678</entry>
Aug 16 18:33:33 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:33:33 user nova-compute[72000]:     </system>
Aug 16 18:33:33 user nova-compute[72000]:   </sysinfo>
Aug 16 18:33:33 user nova-compute[72000]:   <os>
Aug 16 18:33:33 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:33:33 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:33:33 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:33:33 user nova-compute[72000]:   </os>
Aug 16 18:33:33 user nova-compute[72000]:   <features>
Aug 16 18:33:33 user nova-compute[72000]:     <acpi/>
Aug 16 18:33:33 user nova-compute[72000]:     <apic/>
Aug 16 18:33:33 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:33:33 user nova-compute[72000]:   </features>
Aug 16 18:33:33 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:33:33 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:33:33 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:33:33 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:33:33 user nova-compute[72000]:   </clock>
Aug 16 18:33:33 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:33:33 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:33:33 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:33:33 user nova-compute[72000]:   </cpu>
Aug 16 18:33:33 user nova-compute[72000]:   <devices>
Aug 16 18:33:33 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:33:33 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:33:33 user nova-compute[72000]:       <source dev="/dev/sdc"/>
Aug 16 18:33:33 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:33:33 user nova-compute[72000]:       <serial>f979fa74-d153-4197-bbeb-8703dbcbaee9</serial>
Aug 16 18:33:33 user nova-compute[72000]:     </disk>
Aug 16 18:33:33 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:33:33 user nova-compute[72000]:       <mac address="fa:16:3e:75:0c:d9"/>
Aug 16 18:33:33 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:33:33 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:33:33 user nova-compute[72000]:       <target dev="tapd0560bcc-bc"/>
Aug 16 18:33:33 user nova-compute[72000]:     </interface>
Aug 16 18:33:33 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:33:33 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/71a87e9f-7705-40a5-9ca7-9aca0bbae678/console.log" append="off"/>
Aug 16 18:33:33 user nova-compute[72000]:     </serial>
Aug 16 18:33:33 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:33:33 user nova-compute[72000]:     <video>
Aug 16 18:33:33 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:33:33 user nova-compute[72000]:     </video>
Aug 16 18:33:33 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:33:33 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:33:33 user nova-compute[72000]:     </rng>
Aug 16 18:33:33 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:33:33 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:33:33 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:33:33 user nova-compute[72000]:     </memballoon>
Aug 16 18:33:33 user nova-compute[72000]:   </devices>
Aug 16 18:33:33 user nova-compute[72000]: </domain>
Aug 16 18:33:33 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-954955042',display_name='tempest-TestVolumeBootPattern-server-954955042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-954955042',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeH+TllNmCaPuNZ7ZDpdAZ2U1yxhHMIwYWH0or6u0ayqmt4OfmsSY6sfiU9gIn1F/l5zMGgKThIwo23xAxIFCcQn4sdo8OhcvXWf8ZZRA2WVCiWVqY2ogTDLbuarVcb+A==',key_name='tempest-TestVolumeBootPattern-1231120149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-y38f5pet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:33:21Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=71a87e9f-7705-40a5-9ca7-9aca0bbae678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:0c:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0560bcc-bc28-4729-b76f-d4f4405ef4ab,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0560bcc-bc') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG os_vif [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:0c:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0560bcc-bc28-4729-b76f-d4f4405ef4ab,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0560bcc-bc') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0560bcc-bc, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0560bcc-bc, col_values=(('external_ids', {'iface-id': 'd0560bcc-bc28-4729-b76f-d4f4405ef4ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:0c:d9', 'vm-uuid': '71a87e9f-7705-40a5-9ca7-9aca0bbae678'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:33 user nova-compute[72000]: INFO os_vif [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:0c:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0560bcc-bc28-4729-b76f-d4f4405ef4ab,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0560bcc-bc')
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:33:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No VIF found with MAC fa:16:3e:75:0c:d9, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:33:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:33:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-008eb99a-5413-44a9-b780-e6db27bb64c6 req-750a2fe0-7b50-4f52-ba0e-8e9e2fb60eb1 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received event network-vif-plugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:33:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-008eb99a-5413-44a9-b780-e6db27bb64c6 req-750a2fe0-7b50-4f52-ba0e-8e9e2fb60eb1 service nova] Acquiring lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:33:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-008eb99a-5413-44a9-b780-e6db27bb64c6 req-750a2fe0-7b50-4f52-ba0e-8e9e2fb60eb1 service nova] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:33:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-008eb99a-5413-44a9-b780-e6db27bb64c6 req-750a2fe0-7b50-4f52-ba0e-8e9e2fb60eb1 service nova] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:33:34 user nova-compute[72000]: DEBUG nova.compute.manager [req-008eb99a-5413-44a9-b780-e6db27bb64c6 req-750a2fe0-7b50-4f52-ba0e-8e9e2fb60eb1 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] No waiting events found dispatching network-vif-plugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:33:34 user nova-compute[72000]: WARNING nova.compute.manager [req-008eb99a-5413-44a9-b780-e6db27bb64c6 req-750a2fe0-7b50-4f52-ba0e-8e9e2fb60eb1 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received unexpected event network-vif-plugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab for instance with vm_state building and task_state spawning.
Aug 16 18:33:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210816.570314, 71a87e9f-7705-40a5-9ca7-9aca0bbae678 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:33:36 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] VM Resumed (Lifecycle Event)
Aug 16 18:33:36 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Instance spawned successfully.
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:33:36 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210816.5711315, 71a87e9f-7705-40a5-9ca7-9aca0bbae678 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:33:36 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] VM Started (Lifecycle Event)
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:33:36 user nova-compute[72000]: INFO nova.compute.manager [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:33:36 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:33:36 user nova-compute[72000]: INFO nova.compute.manager [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Took 16.02 seconds to build instance.
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-c4718d3e-2bf1-4c4c-bd7e-989ee3a06333 req-ed9987e0-79e7-4a3e-a5d4-0ef81605ef3b service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received event network-vif-plugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c4718d3e-2bf1-4c4c-bd7e-989ee3a06333 req-ed9987e0-79e7-4a3e-a5d4-0ef81605ef3b service nova] Acquiring lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c4718d3e-2bf1-4c4c-bd7e-989ee3a06333 req-ed9987e0-79e7-4a3e-a5d4-0ef81605ef3b service nova] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c4718d3e-2bf1-4c4c-bd7e-989ee3a06333 req-ed9987e0-79e7-4a3e-a5d4-0ef81605ef3b service nova] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:33:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-c4718d3e-2bf1-4c4c-bd7e-989ee3a06333 req-ed9987e0-79e7-4a3e-a5d4-0ef81605ef3b service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] No waiting events found dispatching network-vif-plugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:33:36 user nova-compute[72000]: WARNING nova.compute.manager [req-c4718d3e-2bf1-4c4c-bd7e-989ee3a06333 req-ed9987e0-79e7-4a3e-a5d4-0ef81605ef3b service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received unexpected event network-vif-plugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab for instance with vm_state active and task_state None.
Aug 16 18:33:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ff69002d-bd4a-45e1-b0ea-e96904a08932 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.126s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:33:37 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:33:37 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:33:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:33:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:33:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:33:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:33:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:33:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:33:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [{"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-3ca4f9a6-2790-45d5-ba30-615398c045c4" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:40 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:33:41 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:33:41 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:33:41 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8564MB free_disk=23.670589447021484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 71a87e9f-7705-40a5-9ca7-9aca0bbae678 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:33:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:33:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:33:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:33:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:33:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:33:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:33:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:33:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:33:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:34:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:34:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:34:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:34:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:34:01 user nova-compute[72000]: INFO nova.compute.manager [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Terminating instance
Aug 16 18:34:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:34:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d72e3ec-2a16-42ea-976f-fc3ccd34315a req-4a5f7f6e-5956-4daf-989f-1967ef9a6730 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-vif-unplugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d72e3ec-2a16-42ea-976f-fc3ccd34315a req-4a5f7f6e-5956-4daf-989f-1967ef9a6730 service nova] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d72e3ec-2a16-42ea-976f-fc3ccd34315a req-4a5f7f6e-5956-4daf-989f-1967ef9a6730 service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d72e3ec-2a16-42ea-976f-fc3ccd34315a req-4a5f7f6e-5956-4daf-989f-1967ef9a6730 service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d72e3ec-2a16-42ea-976f-fc3ccd34315a req-4a5f7f6e-5956-4daf-989f-1967ef9a6730 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] No waiting events found dispatching network-vif-unplugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d72e3ec-2a16-42ea-976f-fc3ccd34315a req-4a5f7f6e-5956-4daf-989f-1967ef9a6730 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-vif-unplugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:34:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Instance destroyed successfully.
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'resources' on Instance uuid fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:27:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-306406182',display_name='tempest-ServerActionsTestOtherA-server-306406182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-306406182',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOboTwX+yPl3Cog939zVL+RXhe2iURuYdIg/tydSG7rmvgQL9izant50X7bWgjKoD0OObZiShgjaYDVLpgpQ938h9ReyNLR83Wx2HtCoNu1LYpjzQ+Y1Ln/EOXdF1uY+1g==',key_name='tempest-keypair-1361855606',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-ieyg58ue',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:31:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=fa44ba0e-28c7-4915-8cd0-51fe06eb35f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "address": "fa:16:3e:e0:ae:d6", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46b8ec4a-9d", "ovs_interfaceid": "46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_vif [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46b8ec4a-9d, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:34:02 user nova-compute[72000]: INFO os_vif [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:ae:d6,bridge_name='br-int',has_traffic_filtering=True,id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46b8ec4a-9d')
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zqIKlrNo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:34:02 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[94902bd7-4e95-4453-87d9-82820695e89d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4471edec-174a-483e-812c-719e226a298e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:34:02 user nova-compute[72000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:34:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca (non-flash)
Aug 16 18:34:02 user nova-compute[72000]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:34:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcfe87264d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6f6457-33ae-42c4-8481-197ea1b89abc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0032f-aea9-4936-ba82-02c91dc380eb]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4945bd3c-c409-46a2-8e4f-b4625f6c8cd7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf045c0-44c0-4232-a539-a180714ae686]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bf34c619', '/dev/disk/by-id/scsi-26236616261636232', '/dev/disk/by-id/scsi-1SCST_BIObf34c619-b6abacb2c61e1aa1') {{(pid=83463) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c66de9-ad73-477d-99b3-53934971ca12]: (4, None) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd4acf8-be81-4671-a37f-f565950fb7e0]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[76474faa-c3bb-4bd6-9199-41f04094232b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260]
Aug 16 18:34:02 user nova-compute[72000]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca, portal: 172.16.0.220,3260] successful.
Aug 16 18:34:02 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de0fdb83-e5af-4c05-ba33-702de76f79ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c720a17-0869-40e8-a2b0-9c952bceef38]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] <== disconnect_volume: return (314ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:34:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Deleting instance files /opt/stack/data/nova/instances/fa44ba0e-28c7-4915-8cd0-51fe06eb35f5_del
Aug 16 18:34:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Deletion of /opt/stack/data/nova/instances/fa44ba0e-28c7-4915-8cd0-51fe06eb35f5_del complete
Aug 16 18:34:02 user nova-compute[72000]: INFO nova.compute.manager [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 16 18:34:02 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:34:02 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:34:03 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:34:03 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Took 0.69 seconds to deallocate network for instance.
Aug 16 18:34:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-72cf5ee9-b8a3-4f9e-ad1e-29ce9b98a636 req-4adb2347-bc66-4128-992e-42d0de6b7ed9 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-vif-deleted-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:34:03 user nova-compute[72000]: INFO nova.compute.manager [req-72cf5ee9-b8a3-4f9e-ad1e-29ce9b98a636 req-4adb2347-bc66-4128-992e-42d0de6b7ed9 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Neutron deleted interface 46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9; detaching it from the instance and deleting it from the info cache
Aug 16 18:34:03 user nova-compute[72000]: DEBUG nova.network.neutron [req-72cf5ee9-b8a3-4f9e-ad1e-29ce9b98a636 req-4adb2347-bc66-4128-992e-42d0de6b7ed9 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:34:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-72cf5ee9-b8a3-4f9e-ad1e-29ce9b98a636 req-4adb2347-bc66-4128-992e-42d0de6b7ed9 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Detach interface failed, port_id=46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9, reason: Instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:34:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-d47eae00-bcc2-4d3d-a226-3e6cd16708ff req-7b321ba8-9fc6-4b7f-9f7a-a2ee1d20f999 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:34:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d47eae00-bcc2-4d3d-a226-3e6cd16708ff req-7b321ba8-9fc6-4b7f-9f7a-a2ee1d20f999 service nova] Acquiring lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:34:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d47eae00-bcc2-4d3d-a226-3e6cd16708ff req-7b321ba8-9fc6-4b7f-9f7a-a2ee1d20f999 service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:34:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d47eae00-bcc2-4d3d-a226-3e6cd16708ff req-7b321ba8-9fc6-4b7f-9f7a-a2ee1d20f999 service nova] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:34:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-d47eae00-bcc2-4d3d-a226-3e6cd16708ff req-7b321ba8-9fc6-4b7f-9f7a-a2ee1d20f999 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] No waiting events found dispatching network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:34:04 user nova-compute[72000]: WARNING nova.compute.manager [req-d47eae00-bcc2-4d3d-a226-3e6cd16708ff req-7b321ba8-9fc6-4b7f-9f7a-a2ee1d20f999 service nova] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Received unexpected event network-vif-plugged-46b8ec4a-9d8b-41ef-9c09-0ab1faf99da9 for instance with vm_state active and task_state deleting.
Aug 16 18:34:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:04 user nova-compute[72000]: INFO nova.compute.manager [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Took 0.75 seconds to detach 1 volumes for instance.
Aug 16 18:34:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Deleting volume: de0fdb83-e5af-4c05-ba33-702de76f79ca {{(pid=72000) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 16 18:34:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:34:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:34:04 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:34:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:34:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:34:04 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Deleted allocations for instance fa44ba0e-28c7-4915-8cd0-51fe06eb35f5
Aug 16 18:34:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c26d03bc-b8d3-4d7f-a839-b6f53dc42629 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "fa44ba0e-28c7-4915-8cd0-51fe06eb35f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:34:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:34:17 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210842.3972282, fa44ba0e-28c7-4915-8cd0-51fe06eb35f5 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:34:17 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] VM Stopped (Lifecycle Event)
Aug 16 18:34:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4596fcab-f411-4c35-96ff-afa1ee621c07 None None] [instance: fa44ba0e-28c7-4915-8cd0-51fe06eb35f5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:34:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:34:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:34:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:34:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:34:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:34:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:34:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:34:36 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:34:36 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:34:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:34:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:34:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:34:41 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:34:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:34:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:34:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:34:41 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updating instance_info_cache with network_info: [{"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:34:43 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:34:43 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:34:43 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8641MB free_disk=23.66967010498047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 71a87e9f-7705-40a5-9ca7-9aca0bbae678 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:34:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:34:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:34:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:34:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:34:49 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:34:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:34:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:34:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:34:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:34:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:34:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:34:58 user nova-compute[72000]: INFO nova.compute.manager [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Terminating instance
Aug 16 18:34:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:34:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d0e33cd-1015-44d6-b646-0c7438b06a6f req-9611e155-96d6-4136-b03e-7ef8ccae5c58 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received event network-vif-unplugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d0e33cd-1015-44d6-b646-0c7438b06a6f req-9611e155-96d6-4136-b03e-7ef8ccae5c58 service nova] Acquiring lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d0e33cd-1015-44d6-b646-0c7438b06a6f req-9611e155-96d6-4136-b03e-7ef8ccae5c58 service nova] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d0e33cd-1015-44d6-b646-0c7438b06a6f req-9611e155-96d6-4136-b03e-7ef8ccae5c58 service nova] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d0e33cd-1015-44d6-b646-0c7438b06a6f req-9611e155-96d6-4136-b03e-7ef8ccae5c58 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] No waiting events found dispatching network-vif-unplugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d0e33cd-1015-44d6-b646-0c7438b06a6f req-9611e155-96d6-4136-b03e-7ef8ccae5c58 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received event network-vif-unplugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Instance destroyed successfully.
Aug 16 18:34:59 user nova-compute[72000]: DEBUG nova.objects.instance [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lazy-loading 'resources' on Instance uuid 3ca4f9a6-2790-45d5-ba30-615398c045c4 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:00:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2050389443',display_name='tempest-ServerActionsTestOtherA-server-2050389443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2050389443',id=1,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOboTwX+yPl3Cog939zVL+RXhe2iURuYdIg/tydSG7rmvgQL9izant50X7bWgjKoD0OObZiShgjaYDVLpgpQ938h9ReyNLR83Wx2HtCoNu1LYpjzQ+Y1Ln/EOXdF1uY+1g==',key_name='tempest-keypair-1361855606',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72c4769a48b847f994e32e7c01bd39e0',ramdisk_id='',reservation_id='r-5b1orq5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1630250690',owner_user_name='tempest-ServerActionsTestOtherA-1630250690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:00:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb9c67db30d3443eaf28670635863118',uuid=3ca4f9a6-2790-45d5-ba30-615398c045c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converting VIF {"id": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "address": "fa:16:3e:9d:ae:f2", "network": {"id": "ef126aa7-305b-4006-a5c2-f11fb8f8d9ad", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1043406858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72c4769a48b847f994e32e7c01bd39e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b7a83f2-7b", "ovs_interfaceid": "6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7a83f2-7b') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG os_vif [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7a83f2-7b') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b7a83f2-7b, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:34:59 user nova-compute[72000]: INFO os_vif [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:ae:f2,bridge_name='br-int',has_traffic_filtering=True,id=6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f,network=Network(ef126aa7-305b-4006-a5c2-f11fb8f8d9ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b7a83f2-7b')
Aug 16 18:34:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Deleting instance files /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4_del
Aug 16 18:34:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Deletion of /opt/stack/data/nova/instances/3ca4f9a6-2790-45d5-ba30-615398c045c4_del complete
Aug 16 18:34:59 user nova-compute[72000]: INFO nova.compute.manager [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 16 18:34:59 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:34:59 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:35:00 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:35:00 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Took 0.51 seconds to deallocate network for instance.
Aug 16 18:35:00 user nova-compute[72000]: DEBUG nova.compute.manager [req-936235b3-3f93-441b-aa19-65a3ee996a9e req-27ae7eaa-2c6a-47f6-bafb-4faf2a4abead service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received event network-vif-deleted-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:35:00 user nova-compute[72000]: INFO nova.compute.manager [req-936235b3-3f93-441b-aa19-65a3ee996a9e req-27ae7eaa-2c6a-47f6-bafb-4faf2a4abead service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Neutron deleted interface 6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f; detaching it from the instance and deleting it from the info cache
Aug 16 18:35:00 user nova-compute[72000]: DEBUG nova.network.neutron [req-936235b3-3f93-441b-aa19-65a3ee996a9e req-27ae7eaa-2c6a-47f6-bafb-4faf2a4abead service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:35:00 user nova-compute[72000]: DEBUG nova.compute.manager [req-936235b3-3f93-441b-aa19-65a3ee996a9e req-27ae7eaa-2c6a-47f6-bafb-4faf2a4abead service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Detach interface failed, port_id=6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f, reason: Instance 3ca4f9a6-2790-45d5-ba30-615398c045c4 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:35:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:35:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:35:00 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:35:00 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:35:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:35:00 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Deleted allocations for instance 3ca4f9a6-2790-45d5-ba30-615398c045c4
Aug 16 18:35:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-13143778-93f2-4234-8f3e-a23147c1b176 tempest-ServerActionsTestOtherA-1630250690 tempest-ServerActionsTestOtherA-1630250690-project-member] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.753s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:35:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-ff2a4700-d5f6-44c2-befb-d08998f41ca8 req-860a58d3-0d64-43d6-9820-a05e5f5b7fc1 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received event network-vif-plugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:35:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ff2a4700-d5f6-44c2-befb-d08998f41ca8 req-860a58d3-0d64-43d6-9820-a05e5f5b7fc1 service nova] Acquiring lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:35:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ff2a4700-d5f6-44c2-befb-d08998f41ca8 req-860a58d3-0d64-43d6-9820-a05e5f5b7fc1 service nova] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:35:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ff2a4700-d5f6-44c2-befb-d08998f41ca8 req-860a58d3-0d64-43d6-9820-a05e5f5b7fc1 service nova] Lock "3ca4f9a6-2790-45d5-ba30-615398c045c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:35:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-ff2a4700-d5f6-44c2-befb-d08998f41ca8 req-860a58d3-0d64-43d6-9820-a05e5f5b7fc1 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] No waiting events found dispatching network-vif-plugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:35:01 user nova-compute[72000]: WARNING nova.compute.manager [req-ff2a4700-d5f6-44c2-befb-d08998f41ca8 req-860a58d3-0d64-43d6-9820-a05e5f5b7fc1 service nova] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Received unexpected event network-vif-plugged-6b7a83f2-7bbf-4aee-9fa1-4c93cf1def3f for instance with vm_state deleted and task_state None.
Aug 16 18:35:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:35:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:35:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:35:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:35:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-77171baa-b1bf-4ff9-b119-34253dfed412 req-80aa74d1-a076-43a2-b49d-3102226d482b service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received event network-changed-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:35:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-77171baa-b1bf-4ff9-b119-34253dfed412 req-80aa74d1-a076-43a2-b49d-3102226d482b service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Refreshing instance network info cache due to event network-changed-d0560bcc-bc28-4729-b76f-d4f4405ef4ab. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:35:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-77171baa-b1bf-4ff9-b119-34253dfed412 req-80aa74d1-a076-43a2-b49d-3102226d482b service nova] Acquiring lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:35:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-77171baa-b1bf-4ff9-b119-34253dfed412 req-80aa74d1-a076-43a2-b49d-3102226d482b service nova] Acquired lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:35:12 user nova-compute[72000]: DEBUG nova.network.neutron [req-77171baa-b1bf-4ff9-b119-34253dfed412 req-80aa74d1-a076-43a2-b49d-3102226d482b service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Refreshing network info cache for port d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:35:13 user nova-compute[72000]: DEBUG nova.network.neutron [req-77171baa-b1bf-4ff9-b119-34253dfed412 req-80aa74d1-a076-43a2-b49d-3102226d482b service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updated VIF entry in instance network info cache for port d0560bcc-bc28-4729-b76f-d4f4405ef4ab. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:35:13 user nova-compute[72000]: DEBUG nova.network.neutron [req-77171baa-b1bf-4ff9-b119-34253dfed412 req-80aa74d1-a076-43a2-b49d-3102226d482b service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updating instance_info_cache with network_info: [{"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:35:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-77171baa-b1bf-4ff9-b119-34253dfed412 req-80aa74d1-a076-43a2-b49d-3102226d482b service nova] Releasing lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:35:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:14 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692210899.408855, 3ca4f9a6-2790-45d5-ba30-615398c045c4 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:35:14 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] VM Stopped (Lifecycle Event)
Aug 16 18:35:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3031ab74-122b-4827-b98f-0bf574b722e6 None None] [instance: 3ca4f9a6-2790-45d5-ba30-615398c045c4] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:35:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "211a60ff-dd5d-46e2-bc85-087ea248bb63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:35:26 user nova-compute[72000]: INFO nova.compute.claims [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Claim successful on node user
Aug 16 18:35:26 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:35:26 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:35:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG nova.policy [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1107151852b84f3185157fff0c0f3495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b758c455ec774042967fb617787c1cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:35:26 user nova-compute[72000]: INFO nova.virt.block_device [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Booting with volume b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc at /dev/vda
Aug 16 18:35:26 user nova-compute[72000]: DEBUG os_brick.utils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ad199-6502-4aa8-a94e-c2916ba61df6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[560b2643-a263-41d8-b8cb-96aa8a8a7608]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbf3544-67d2-415d-ba8d-eb07a087255c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c3302a-5ab7-491b-9035-c126477bd614]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:35:26 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:35:26 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb2320c-e870-44a5-8112-cbbbaa611e91]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG os_brick.utils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:35:26 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updating existing volume attachment record: 1b8bfcfe-3fa1-4e0d-9a86-10ccbd2f0a60 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:35:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Successfully created port: 32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Successfully updated port: 32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquired lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-f25fffa5-0bce-4454-b386-88090226ef85 req-97cc620d-08ff-4716-aeef-abcb57c0e407 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received event network-changed-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG nova.compute.manager [req-f25fffa5-0bce-4454-b386-88090226ef85 req-97cc620d-08ff-4716-aeef-abcb57c0e407 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Refreshing instance network info cache due to event network-changed-32ca459f-0896-46b9-9184-4d9249484eb4. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f25fffa5-0bce-4454-b386-88090226ef85 req-97cc620d-08ff-4716-aeef-abcb57c0e407 service nova] Acquiring lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG nova.network.neutron [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updating instance_info_cache with network_info: [{"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Releasing lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Instance network_info: |[{"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f25fffa5-0bce-4454-b386-88090226ef85 req-97cc620d-08ff-4716-aeef-abcb57c0e407 service nova] Acquired lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:35:28 user nova-compute[72000]: DEBUG nova.network.neutron [req-f25fffa5-0bce-4454-b386-88090226ef85 req-97cc620d-08ff-4716-aeef-abcb57c0e407 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Refreshing network info cache for port 32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:35:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-f25fffa5-0bce-4454-b386-88090226ef85 req-97cc620d-08ff-4716-aeef-abcb57c0e407 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updated VIF entry in instance network info cache for port 32ca459f-0896-46b9-9184-4d9249484eb4. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:35:29 user nova-compute[72000]: DEBUG nova.network.neutron [req-f25fffa5-0bce-4454-b386-88090226ef85 req-97cc620d-08ff-4716-aeef-abcb57c0e407 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updating instance_info_cache with network_info: [{"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:35:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f25fffa5-0bce-4454-b386-88090226ef85 req-97cc620d-08ff-4716-aeef-abcb57c0e407 service nova] Releasing lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:35:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:35:36 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Creating image(s)
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Ensure instance console log exists: /opt/stack/data/nova/instances/211a60ff-dd5d-46e2-bc85-087ea248bb63/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Start _get_guest_xml network_info=[{"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onQmvJOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '211a60ff-dd5d-46e2-bc85-087ea248bb63', 'attached_at': '', 'detached_at': '', 'volume_id': 'b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc', 'serial': 'b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc'}, 'attachment_id': '1b8bfcfe-3fa1-4e0d-9a86-10ccbd2f0a60', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:35:36 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:35:36 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:35:36 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onQmvJOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:35:37 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:35:37 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:35:37 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c8ff7d-c983-43b5-91de-acb6ac4bdf5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:35:37 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58cdf9f-71af-405b-8e58-1dd59e78cdf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc] added
Aug 16 18:35:37 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdec7a87-6a85-4b82-bd35-00900160c405]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[52160942-222c-4641-92ea-b2801567547f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v onQmvJOw {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v onQmvJOw" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb73852f-77af-44ff-8465-f0a8430bf246]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'onQmvJOw'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60aaeea-057f-420b-9d04-bb1de519ccf9]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e89de9-7da5-4548-b96e-991d0a7754a5]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:35:37 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:35:37 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7128e19-13dd-4867-abcb-9a2231edb28e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc, portal: 172.16.0.220,3260]
Aug 16 18:35:37 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc, portal: 172.16.0.220,3260] successful.
Aug 16 18:35:37 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a4a15a-0bf3-49f2-8169-0b765a599535]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ef44e5-b878-41b9-bbe6-bbdc7f3efeb0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:35:37 user nova-compute[72000]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc (non-flash)
Aug 16 18:35:37 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:35:37 user nova-compute[72000]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc (non-flash)
Aug 16 18:35:37 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0840218-ab09-44fb-9482-88de360f2dcc]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:35:37 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onQmvJOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26331626637386165', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331626637386165', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-929255524',display_name='tempest-TestVolumeBootPattern-server-929255524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-929255524',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeH+TllNmCaPuNZ7ZDpdAZ2U1yxhHMIwYWH0or6u0ayqmt4OfmsSY6sfiU9gIn1F/l5zMGgKThIwo23xAxIFCcQn4sdo8OhcvXWf8ZZRA2WVCiWVqY2ogTDLbuarVcb+A==',key_name='tempest-TestVolumeBootPattern-1231120149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-zwx86v9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:35:27Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=211a60ff-dd5d-46e2-bc85-087ea248bb63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:6a:1c,bridge_name='br-int',has_traffic_filtering=True,id=32ca459f-0896-46b9-9184-4d9249484eb4,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32ca459f-08') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'pci_devices' on Instance uuid 211a60ff-dd5d-46e2-bc85-087ea248bb63 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:35:38 user nova-compute[72000]:   <uuid>211a60ff-dd5d-46e2-bc85-087ea248bb63</uuid>
Aug 16 18:35:38 user nova-compute[72000]:   <name>instance-0000002b</name>
Aug 16 18:35:38 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:35:38 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:35:38 user nova-compute[72000]:   <metadata>
Aug 16 18:35:38 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:35:38 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:35:38 user nova-compute[72000]:       <nova:name>tempest-TestVolumeBootPattern-server-929255524</nova:name>
Aug 16 18:35:38 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:35:36</nova:creationTime>
Aug 16 18:35:38 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:35:38 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:35:38 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:35:38 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:35:38 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:35:38 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:35:38 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:35:38 user nova-compute[72000]:       <nova:owner>
Aug 16 18:35:38 user nova-compute[72000]:         <nova:user uuid="1107151852b84f3185157fff0c0f3495">tempest-TestVolumeBootPattern-109968882-project-member</nova:user>
Aug 16 18:35:38 user nova-compute[72000]:         <nova:project uuid="b758c455ec774042967fb617787c1cbd">tempest-TestVolumeBootPattern-109968882</nova:project>
Aug 16 18:35:38 user nova-compute[72000]:       </nova:owner>
Aug 16 18:35:38 user nova-compute[72000]:       <nova:ports>
Aug 16 18:35:38 user nova-compute[72000]:         <nova:port uuid="32ca459f-0896-46b9-9184-4d9249484eb4">
Aug 16 18:35:38 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 16 18:35:38 user nova-compute[72000]:         </nova:port>
Aug 16 18:35:38 user nova-compute[72000]:       </nova:ports>
Aug 16 18:35:38 user nova-compute[72000]:     </nova:instance>
Aug 16 18:35:38 user nova-compute[72000]:   </metadata>
Aug 16 18:35:38 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:35:38 user nova-compute[72000]:     <system>
Aug 16 18:35:38 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:35:38 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:35:38 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:35:38 user nova-compute[72000]:       <entry name="serial">211a60ff-dd5d-46e2-bc85-087ea248bb63</entry>
Aug 16 18:35:38 user nova-compute[72000]:       <entry name="uuid">211a60ff-dd5d-46e2-bc85-087ea248bb63</entry>
Aug 16 18:35:38 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:35:38 user nova-compute[72000]:     </system>
Aug 16 18:35:38 user nova-compute[72000]:   </sysinfo>
Aug 16 18:35:38 user nova-compute[72000]:   <os>
Aug 16 18:35:38 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:35:38 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:35:38 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:35:38 user nova-compute[72000]:   </os>
Aug 16 18:35:38 user nova-compute[72000]:   <features>
Aug 16 18:35:38 user nova-compute[72000]:     <acpi/>
Aug 16 18:35:38 user nova-compute[72000]:     <apic/>
Aug 16 18:35:38 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:35:38 user nova-compute[72000]:   </features>
Aug 16 18:35:38 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:35:38 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:35:38 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:35:38 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:35:38 user nova-compute[72000]:   </clock>
Aug 16 18:35:38 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:35:38 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:35:38 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:35:38 user nova-compute[72000]:   </cpu>
Aug 16 18:35:38 user nova-compute[72000]:   <devices>
Aug 16 18:35:38 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:35:38 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:35:38 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 18:35:38 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:35:38 user nova-compute[72000]:       <serial>b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc</serial>
Aug 16 18:35:38 user nova-compute[72000]:     </disk>
Aug 16 18:35:38 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:35:38 user nova-compute[72000]:       <mac address="fa:16:3e:ea:6a:1c"/>
Aug 16 18:35:38 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:35:38 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:35:38 user nova-compute[72000]:       <target dev="tap32ca459f-08"/>
Aug 16 18:35:38 user nova-compute[72000]:     </interface>
Aug 16 18:35:38 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:35:38 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/211a60ff-dd5d-46e2-bc85-087ea248bb63/console.log" append="off"/>
Aug 16 18:35:38 user nova-compute[72000]:     </serial>
Aug 16 18:35:38 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:35:38 user nova-compute[72000]:     <video>
Aug 16 18:35:38 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:35:38 user nova-compute[72000]:     </video>
Aug 16 18:35:38 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:35:38 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:35:38 user nova-compute[72000]:     </rng>
Aug 16 18:35:38 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:35:38 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:35:38 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:35:38 user nova-compute[72000]:     </memballoon>
Aug 16 18:35:38 user nova-compute[72000]:   </devices>
Aug 16 18:35:38 user nova-compute[72000]: </domain>
Aug 16 18:35:38 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-929255524',display_name='tempest-TestVolumeBootPattern-server-929255524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-929255524',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeH+TllNmCaPuNZ7ZDpdAZ2U1yxhHMIwYWH0or6u0ayqmt4OfmsSY6sfiU9gIn1F/l5zMGgKThIwo23xAxIFCcQn4sdo8OhcvXWf8ZZRA2WVCiWVqY2ogTDLbuarVcb+A==',key_name='tempest-TestVolumeBootPattern-1231120149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-zwx86v9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:35:27Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=211a60ff-dd5d-46e2-bc85-087ea248bb63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:6a:1c,bridge_name='br-int',has_traffic_filtering=True,id=32ca459f-0896-46b9-9184-4d9249484eb4,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32ca459f-08') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG os_vif [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:6a:1c,bridge_name='br-int',has_traffic_filtering=True,id=32ca459f-0896-46b9-9184-4d9249484eb4,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32ca459f-08') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32ca459f-08, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32ca459f-08, col_values=(('external_ids', {'iface-id': '32ca459f-0896-46b9-9184-4d9249484eb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:6a:1c', 'vm-uuid': '211a60ff-dd5d-46e2-bc85-087ea248bb63'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:38 user nova-compute[72000]: INFO os_vif [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:6a:1c,bridge_name='br-int',has_traffic_filtering=True,id=32ca459f-0896-46b9-9184-4d9249484eb4,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32ca459f-08')
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] No VIF found with MAC fa:16:3e:ea:6a:1c, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:35:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:35:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:35:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-3404e1b5-3beb-4be3-879a-a59e575908a1 req-128b8642-f58e-48d2-96d7-9dd7b7ca3773 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received event network-vif-plugged-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:35:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3404e1b5-3beb-4be3-879a-a59e575908a1 req-128b8642-f58e-48d2-96d7-9dd7b7ca3773 service nova] Acquiring lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:35:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3404e1b5-3beb-4be3-879a-a59e575908a1 req-128b8642-f58e-48d2-96d7-9dd7b7ca3773 service nova] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:35:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3404e1b5-3beb-4be3-879a-a59e575908a1 req-128b8642-f58e-48d2-96d7-9dd7b7ca3773 service nova] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:35:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-3404e1b5-3beb-4be3-879a-a59e575908a1 req-128b8642-f58e-48d2-96d7-9dd7b7ca3773 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] No waiting events found dispatching network-vif-plugged-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:35:39 user nova-compute[72000]: WARNING nova.compute.manager [req-3404e1b5-3beb-4be3-879a-a59e575908a1 req-128b8642-f58e-48d2-96d7-9dd7b7ca3773 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received unexpected event network-vif-plugged-32ca459f-0896-46b9-9184-4d9249484eb4 for instance with vm_state building and task_state spawning.
Aug 16 18:35:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210941.7871554, 211a60ff-dd5d-46e2-bc85-087ea248bb63 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:35:41 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] VM Resumed (Lifecycle Event)
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:35:41 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Instance spawned successfully.
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:35:41 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210941.7882624, 211a60ff-dd5d-46e2-bc85-087ea248bb63 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:35:41 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] VM Started (Lifecycle Event)
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:35:41 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:35:41 user nova-compute[72000]: INFO nova.compute.manager [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Took 4.97 seconds to spawn the instance on the hypervisor.
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-ada74b13-622f-4da0-a352-4bcbe41be64f req-6320570d-08d4-4800-ba6d-ee673a924338 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received event network-vif-plugged-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ada74b13-622f-4da0-a352-4bcbe41be64f req-6320570d-08d4-4800-ba6d-ee673a924338 service nova] Acquiring lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ada74b13-622f-4da0-a352-4bcbe41be64f req-6320570d-08d4-4800-ba6d-ee673a924338 service nova] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ada74b13-622f-4da0-a352-4bcbe41be64f req-6320570d-08d4-4800-ba6d-ee673a924338 service nova] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:35:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-ada74b13-622f-4da0-a352-4bcbe41be64f req-6320570d-08d4-4800-ba6d-ee673a924338 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] No waiting events found dispatching network-vif-plugged-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:35:41 user nova-compute[72000]: WARNING nova.compute.manager [req-ada74b13-622f-4da0-a352-4bcbe41be64f req-6320570d-08d4-4800-ba6d-ee673a924338 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received unexpected event network-vif-plugged-32ca459f-0896-46b9-9184-4d9249484eb4 for instance with vm_state building and task_state spawning.
Aug 16 18:35:41 user nova-compute[72000]: INFO nova.compute.manager [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Took 15.66 seconds to build instance.
Aug 16 18:35:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ebb8971c-ac21-43c7-ae19-ac573983a1f2 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.752s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:35:42 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:35:42 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:35:42 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:35:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:35:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:35:42 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:35:42 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 71a87e9f-7705-40a5-9ca7-9aca0bbae678 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updating instance_info_cache with network_info: [{"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:35:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:35:44 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:35:44 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:35:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=23.695438385009766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 71a87e9f-7705-40a5-9ca7-9aca0bbae678 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 211a60ff-dd5d-46e2-bc85-087ea248bb63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:35:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:35:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:49 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:35:49 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:35:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:35:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:35:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:35:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:36:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:01 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:36:01 user nova-compute[72000]: INFO nova.compute.claims [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Claim successful on node user
Aug 16 18:36:02 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:36:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:36:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG nova.policy [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26718511a87349cfa05d63a131cdeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb2848418984c0f8c5f6418555534c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:36:02 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Creating image(s)
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "/opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "/opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk 1073741824" returned: 0 in 0.058s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Successfully created port: 2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Cannot resize image /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.objects.instance [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'migration_context' on Instance uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Ensure instance console log exists: /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Verify base images {{(pid=72000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Image id c19ae381-62a6-4e07-8c3a-fefacf5c24ea yields fingerprint e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 {{(pid=72000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 18:36:03 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] image c19ae381-62a6-4e07-8c3a-fefacf5c24ea at (/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56): checking
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] image c19ae381-62a6-4e07-8c3a-fefacf5c24ea at (/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56): image is in use {{(pid=72000) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] 6c9ae44a-2f84-46cd-8515-c993397e5d7e is a valid instance name {{(pid=72000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] 6c9ae44a-2f84-46cd-8515-c993397e5d7e has a disk file {{(pid=72000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e is backed by e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 {{(pid=72000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] 211a60ff-dd5d-46e2-bc85-087ea248bb63 is a valid instance name {{(pid=72000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] 71a87e9f-7705-40a5-9ca7-9aca0bbae678 is a valid instance name {{(pid=72000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 18:36:03 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4
Aug 16 18:36:03 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661
Aug 16 18:36:03 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39
Aug 16 18:36:03 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d
Aug 16 18:36:03 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69
Aug 16 18:36:03 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Active base files: /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56
Aug 16 18:36:03 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Removable base files: /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4 /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661 /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39 /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69
Aug 16 18:36:03 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4
Aug 16 18:36:03 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661
Aug 16 18:36:03 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39
Aug 16 18:36:03 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d
Aug 16 18:36:03 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Verification complete {{(pid=72000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Verify swap images {{(pid=72000) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 16 18:36:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Verify ephemeral images {{(pid=72000) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Successfully updated port: 2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquired lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-78f3a78c-fea1-4785-b21d-d76eb6b4086a req-51db0b18-9894-44ab-b716-a43df70df5a0 service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Received event network-changed-2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-78f3a78c-fea1-4785-b21d-d76eb6b4086a req-51db0b18-9894-44ab-b716-a43df70df5a0 service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Refreshing instance network info cache due to event network-changed-2e9d7678-b733-426d-bcdf-68a40b8a981b. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-78f3a78c-fea1-4785-b21d-d76eb6b4086a req-51db0b18-9894-44ab-b716-a43df70df5a0 service nova] Acquiring lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.network.neutron [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updating instance_info_cache with network_info: [{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Releasing lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Instance network_info: |[{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-78f3a78c-fea1-4785-b21d-d76eb6b4086a req-51db0b18-9894-44ab-b716-a43df70df5a0 service nova] Acquired lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.network.neutron [req-78f3a78c-fea1-4785-b21d-d76eb6b4086a req-51db0b18-9894-44ab-b716-a43df70df5a0 service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Refreshing network info cache for port 2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Start _get_guest_xml network_info=[{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:36:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:36:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-659539355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-659539355',id=44,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-55duepyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:36:02Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=6c9ae44a-2f84-46cd-8515-c993397e5d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e9d7678-b733-426d-bcdf-68a40b8a981b,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e9d7678-b7') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.objects.instance [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:36:04 user nova-compute[72000]:   <uuid>6c9ae44a-2f84-46cd-8515-c993397e5d7e</uuid>
Aug 16 18:36:04 user nova-compute[72000]:   <name>instance-0000002c</name>
Aug 16 18:36:04 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:36:04 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:36:04 user nova-compute[72000]:   <metadata>
Aug 16 18:36:04 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:36:04 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:36:04 user nova-compute[72000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-659539355</nova:name>
Aug 16 18:36:04 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:36:04</nova:creationTime>
Aug 16 18:36:04 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:36:04 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:36:04 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:36:04 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:36:04 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:36:04 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:36:04 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:36:04 user nova-compute[72000]:       <nova:owner>
Aug 16 18:36:04 user nova-compute[72000]:         <nova:user uuid="26718511a87349cfa05d63a131cdeafa">tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member</nova:user>
Aug 16 18:36:04 user nova-compute[72000]:         <nova:project uuid="efb2848418984c0f8c5f6418555534c5">tempest-ServerBootFromVolumeStableRescueTest-761401575</nova:project>
Aug 16 18:36:04 user nova-compute[72000]:       </nova:owner>
Aug 16 18:36:04 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:36:04 user nova-compute[72000]:       <nova:ports>
Aug 16 18:36:04 user nova-compute[72000]:         <nova:port uuid="2e9d7678-b733-426d-bcdf-68a40b8a981b">
Aug 16 18:36:04 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 18:36:04 user nova-compute[72000]:         </nova:port>
Aug 16 18:36:04 user nova-compute[72000]:       </nova:ports>
Aug 16 18:36:04 user nova-compute[72000]:     </nova:instance>
Aug 16 18:36:04 user nova-compute[72000]:   </metadata>
Aug 16 18:36:04 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:36:04 user nova-compute[72000]:     <system>
Aug 16 18:36:04 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:36:04 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:36:04 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:36:04 user nova-compute[72000]:       <entry name="serial">6c9ae44a-2f84-46cd-8515-c993397e5d7e</entry>
Aug 16 18:36:04 user nova-compute[72000]:       <entry name="uuid">6c9ae44a-2f84-46cd-8515-c993397e5d7e</entry>
Aug 16 18:36:04 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:36:04 user nova-compute[72000]:     </system>
Aug 16 18:36:04 user nova-compute[72000]:   </sysinfo>
Aug 16 18:36:04 user nova-compute[72000]:   <os>
Aug 16 18:36:04 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:36:04 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:36:04 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:36:04 user nova-compute[72000]:   </os>
Aug 16 18:36:04 user nova-compute[72000]:   <features>
Aug 16 18:36:04 user nova-compute[72000]:     <acpi/>
Aug 16 18:36:04 user nova-compute[72000]:     <apic/>
Aug 16 18:36:04 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:36:04 user nova-compute[72000]:   </features>
Aug 16 18:36:04 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:36:04 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:36:04 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:36:04 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:36:04 user nova-compute[72000]:   </clock>
Aug 16 18:36:04 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:36:04 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:36:04 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:36:04 user nova-compute[72000]:   </cpu>
Aug 16 18:36:04 user nova-compute[72000]:   <devices>
Aug 16 18:36:04 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:36:04 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:36:04 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk"/>
Aug 16 18:36:04 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:36:04 user nova-compute[72000]:     </disk>
Aug 16 18:36:04 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:36:04 user nova-compute[72000]:       <mac address="fa:16:3e:e8:94:9b"/>
Aug 16 18:36:04 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:36:04 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:36:04 user nova-compute[72000]:       <target dev="tap2e9d7678-b7"/>
Aug 16 18:36:04 user nova-compute[72000]:     </interface>
Aug 16 18:36:04 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:36:04 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/console.log" append="off"/>
Aug 16 18:36:04 user nova-compute[72000]:     </serial>
Aug 16 18:36:04 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:36:04 user nova-compute[72000]:     <video>
Aug 16 18:36:04 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:36:04 user nova-compute[72000]:     </video>
Aug 16 18:36:04 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:36:04 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:36:04 user nova-compute[72000]:     </rng>
Aug 16 18:36:04 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:36:04 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:36:04 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:36:04 user nova-compute[72000]:     </memballoon>
Aug 16 18:36:04 user nova-compute[72000]:   </devices>
Aug 16 18:36:04 user nova-compute[72000]: </domain>
Aug 16 18:36:04 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-659539355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-659539355',id=44,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-55duepyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:36:02Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=6c9ae44a-2f84-46cd-8515-c993397e5d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e9d7678-b733-426d-bcdf-68a40b8a981b,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e9d7678-b7') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG os_vif [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e9d7678-b733-426d-bcdf-68a40b8a981b,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e9d7678-b7') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e9d7678-b7, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e9d7678-b7, col_values=(('external_ids', {'iface-id': '2e9d7678-b733-426d-bcdf-68a40b8a981b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:94:9b', 'vm-uuid': '6c9ae44a-2f84-46cd-8515-c993397e5d7e'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:04 user nova-compute[72000]: INFO os_vif [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e9d7678-b733-426d-bcdf-68a40b8a981b,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e9d7678-b7')
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:36:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No VIF found with MAC fa:16:3e:e8:94:9b, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:36:05 user nova-compute[72000]: DEBUG nova.network.neutron [req-78f3a78c-fea1-4785-b21d-d76eb6b4086a req-51db0b18-9894-44ab-b716-a43df70df5a0 service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updated VIF entry in instance network info cache for port 2e9d7678-b733-426d-bcdf-68a40b8a981b. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:36:05 user nova-compute[72000]: DEBUG nova.network.neutron [req-78f3a78c-fea1-4785-b21d-d76eb6b4086a req-51db0b18-9894-44ab-b716-a43df70df5a0 service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updating instance_info_cache with network_info: [{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:36:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-78f3a78c-fea1-4785-b21d-d76eb6b4086a req-51db0b18-9894-44ab-b716-a43df70df5a0 service nova] Releasing lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:36:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-43d4252c-21d8-4aad-acbe-6d5343653c21 req-8ae15c86-43e2-424c-a556-b50110fb2a6f service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Received event network-vif-plugged-2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:36:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-43d4252c-21d8-4aad-acbe-6d5343653c21 req-8ae15c86-43e2-424c-a556-b50110fb2a6f service nova] Acquiring lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-43d4252c-21d8-4aad-acbe-6d5343653c21 req-8ae15c86-43e2-424c-a556-b50110fb2a6f service nova] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-43d4252c-21d8-4aad-acbe-6d5343653c21 req-8ae15c86-43e2-424c-a556-b50110fb2a6f service nova] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-43d4252c-21d8-4aad-acbe-6d5343653c21 req-8ae15c86-43e2-424c-a556-b50110fb2a6f service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] No waiting events found dispatching network-vif-plugged-2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:36:06 user nova-compute[72000]: WARNING nova.compute.manager [req-43d4252c-21d8-4aad-acbe-6d5343653c21 req-8ae15c86-43e2-424c-a556-b50110fb2a6f service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Received unexpected event network-vif-plugged-2e9d7678-b733-426d-bcdf-68a40b8a981b for instance with vm_state building and task_state spawning.
Aug 16 18:36:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210968.1124942, 6c9ae44a-2f84-46cd-8515-c993397e5d7e => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:36:08 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] VM Resumed (Lifecycle Event)
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:36:08 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Instance spawned successfully.
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:36:08 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692210968.114652, 6c9ae44a-2f84-46cd-8515-c993397e5d7e => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:36:08 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] VM Started (Lifecycle Event)
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:36:08 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:36:08 user nova-compute[72000]: INFO nova.compute.manager [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Took 5.84 seconds to spawn the instance on the hypervisor.
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:36:08 user nova-compute[72000]: INFO nova.compute.manager [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Took 6.39 seconds to build instance.
Aug 16 18:36:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-101e9953-c31b-484e-9810-274299f38d1c tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.486s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-8f6cd946-24dc-4566-8fd7-12de483cdc5e req-a8c93c2b-2aa4-43f0-98d4-91ae1598cdfa service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Received event network-vif-plugged-2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f6cd946-24dc-4566-8fd7-12de483cdc5e req-a8c93c2b-2aa4-43f0-98d4-91ae1598cdfa service nova] Acquiring lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f6cd946-24dc-4566-8fd7-12de483cdc5e req-a8c93c2b-2aa4-43f0-98d4-91ae1598cdfa service nova] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f6cd946-24dc-4566-8fd7-12de483cdc5e req-a8c93c2b-2aa4-43f0-98d4-91ae1598cdfa service nova] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-8f6cd946-24dc-4566-8fd7-12de483cdc5e req-a8c93c2b-2aa4-43f0-98d4-91ae1598cdfa service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] No waiting events found dispatching network-vif-plugged-2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:36:08 user nova-compute[72000]: WARNING nova.compute.manager [req-8f6cd946-24dc-4566-8fd7-12de483cdc5e req-a8c93c2b-2aa4-43f0-98d4-91ae1598cdfa service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Received unexpected event network-vif-plugged-2e9d7678-b733-426d-bcdf-68a40b8a981b for instance with vm_state active and task_state None.
Aug 16 18:36:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:36:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:36:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:36:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:36:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:36:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:32 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:42 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:42 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:36:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:36:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:36:42 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updating instance_info_cache with network_info: [{"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:36:43 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:36:44 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:36:44 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8506MB free_disk=23.65740203857422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 71a87e9f-7705-40a5-9ca7-9aca0bbae678 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 211a60ff-dd5d-46e2-bc85-087ea248bb63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:36:44 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:36:45 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:36:45 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:36:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:36:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:36:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:36:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:36:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:36:56 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:36:56 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:36:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:36:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:36:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:36:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:36:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:36:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:36:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:37:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:37:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:37:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:37:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:37:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:37:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:37:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-42a60b42-8d70-42d0-a22e-26046749d597 req-cdf6b7e2-64a6-482d-9ade-4b88195bb24c service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received event network-changed-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:37:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-42a60b42-8d70-42d0-a22e-26046749d597 req-cdf6b7e2-64a6-482d-9ade-4b88195bb24c service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Refreshing instance network info cache due to event network-changed-32ca459f-0896-46b9-9184-4d9249484eb4. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:37:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42a60b42-8d70-42d0-a22e-26046749d597 req-cdf6b7e2-64a6-482d-9ade-4b88195bb24c service nova] Acquiring lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:37:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42a60b42-8d70-42d0-a22e-26046749d597 req-cdf6b7e2-64a6-482d-9ade-4b88195bb24c service nova] Acquired lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:37:18 user nova-compute[72000]: DEBUG nova.network.neutron [req-42a60b42-8d70-42d0-a22e-26046749d597 req-cdf6b7e2-64a6-482d-9ade-4b88195bb24c service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Refreshing network info cache for port 32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:37:18 user nova-compute[72000]: DEBUG nova.network.neutron [req-42a60b42-8d70-42d0-a22e-26046749d597 req-cdf6b7e2-64a6-482d-9ade-4b88195bb24c service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updated VIF entry in instance network info cache for port 32ca459f-0896-46b9-9184-4d9249484eb4. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:37:18 user nova-compute[72000]: DEBUG nova.network.neutron [req-42a60b42-8d70-42d0-a22e-26046749d597 req-cdf6b7e2-64a6-482d-9ade-4b88195bb24c service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updating instance_info_cache with network_info: [{"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:37:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-42a60b42-8d70-42d0-a22e-26046749d597 req-cdf6b7e2-64a6-482d-9ade-4b88195bb24c service nova] Releasing lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-638ac61f-43ff-478c-a1fb-65d9ab98fcaf req-aa9290ef-59ba-4aeb-a9f6-fd137abd8a06 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received event network-changed-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-638ac61f-43ff-478c-a1fb-65d9ab98fcaf req-aa9290ef-59ba-4aeb-a9f6-fd137abd8a06 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Refreshing instance network info cache due to event network-changed-32ca459f-0896-46b9-9184-4d9249484eb4. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-638ac61f-43ff-478c-a1fb-65d9ab98fcaf req-aa9290ef-59ba-4aeb-a9f6-fd137abd8a06 service nova] Acquiring lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-638ac61f-43ff-478c-a1fb-65d9ab98fcaf req-aa9290ef-59ba-4aeb-a9f6-fd137abd8a06 service nova] Acquired lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG nova.network.neutron [req-638ac61f-43ff-478c-a1fb-65d9ab98fcaf req-aa9290ef-59ba-4aeb-a9f6-fd137abd8a06 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Refreshing network info cache for port 32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "211a60ff-dd5d-46e2-bc85-087ea248bb63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:37:19 user nova-compute[72000]: INFO nova.compute.manager [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Terminating instance
Aug 16 18:37:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG nova.network.neutron [req-638ac61f-43ff-478c-a1fb-65d9ab98fcaf req-aa9290ef-59ba-4aeb-a9f6-fd137abd8a06 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updated VIF entry in instance network info cache for port 32ca459f-0896-46b9-9184-4d9249484eb4. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG nova.network.neutron [req-638ac61f-43ff-478c-a1fb-65d9ab98fcaf req-aa9290ef-59ba-4aeb-a9f6-fd137abd8a06 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updating instance_info_cache with network_info: [{"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:37:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-638ac61f-43ff-478c-a1fb-65d9ab98fcaf req-aa9290ef-59ba-4aeb-a9f6-fd137abd8a06 service nova] Releasing lock "refresh_cache-211a60ff-dd5d-46e2-bc85-087ea248bb63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:37:20 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Instance destroyed successfully.
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.objects.instance [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'resources' on Instance uuid 211a60ff-dd5d-46e2-bc85-087ea248bb63 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-929255524',display_name='tempest-TestVolumeBootPattern-server-929255524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-929255524',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeH+TllNmCaPuNZ7ZDpdAZ2U1yxhHMIwYWH0or6u0ayqmt4OfmsSY6sfiU9gIn1F/l5zMGgKThIwo23xAxIFCcQn4sdo8OhcvXWf8ZZRA2WVCiWVqY2ogTDLbuarVcb+A==',key_name='tempest-TestVolumeBootPattern-1231120149',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-zwx86v9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:35:42Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=211a60ff-dd5d-46e2-bc85-087ea248bb63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "32ca459f-0896-46b9-9184-4d9249484eb4", "address": "fa:16:3e:ea:6a:1c", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32ca459f-08", "ovs_interfaceid": "32ca459f-0896-46b9-9184-4d9249484eb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:6a:1c,bridge_name='br-int',has_traffic_filtering=True,id=32ca459f-0896-46b9-9184-4d9249484eb4,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32ca459f-08') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_vif [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:6a:1c,bridge_name='br-int',has_traffic_filtering=True,id=32ca459f-0896-46b9-9184-4d9249484eb4,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32ca459f-08') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32ca459f-08, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:37:20 user nova-compute[72000]: INFO os_vif [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:6a:1c,bridge_name='br-int',has_traffic_filtering=True,id=32ca459f-0896-46b9-9184-4d9249484eb4,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32ca459f-08')
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onQmvJOw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:37:20 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf820e4-6cf2-4509-9d97-af84be441be9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a98aa72-e1a8-4ad7-b7b4-94ff68958c43]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:37:20 user nova-compute[72000]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc (non-flash)
Aug 16 18:37:20 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:37:20 user nova-compute[72000]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc (non-flash)
Aug 16 18:37:20 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0085beef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[064fdfe4-4630-41cb-900b-e45741126990]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac54f61-f6f2-465b-90ee-3971f421a8d7]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f421ea-4b1f-46dc-b8f1-4dd167c8466a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received event network-vif-unplugged-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] Acquiring lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] No waiting events found dispatching network-vif-unplugged-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received event network-vif-unplugged-32ca459f-0896-46b9-9184-4d9249484eb4 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received event network-vif-plugged-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] Acquiring lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] No waiting events found dispatching network-vif-plugged-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:37:20 user nova-compute[72000]: WARNING nova.compute.manager [req-187c392e-b5ba-4270-8598-1ae41e739bcb req-dba2a36b-608d-47e5-bb75-da1c8c73ee15 service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received unexpected event network-vif-plugged-32ca459f-0896-46b9-9184-4d9249484eb4 for instance with vm_state active and task_state deleting.
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa570b4-d0ae-4e72-b417-c15340c5c03f]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[458ded3b-c76a-4abf-a94d-04aa0c72e199]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72e4a04-122c-42ff-9004-7f0eb78ce37e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc, portal: 172.16.0.220,3260]
Aug 16 18:37:20 user nova-compute[72000]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc, portal: 172.16.0.220,3260] successful.
Aug 16 18:37:20 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37c8e8c-70bd-4ed2-a59e-cc95c2a780dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bda96c-3451-42af-a413-8f3731afea6b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== disconnect_volume: return (292ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:37:20 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Deleting instance files /opt/stack/data/nova/instances/211a60ff-dd5d-46e2-bc85-087ea248bb63_del
Aug 16 18:37:20 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Deletion of /opt/stack/data/nova/instances/211a60ff-dd5d-46e2-bc85-087ea248bb63_del complete
Aug 16 18:37:20 user nova-compute[72000]: INFO nova.compute.manager [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 16 18:37:20 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:37:20 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:37:21 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Took 0.41 seconds to deallocate network for instance.
Aug 16 18:37:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-7201603c-2e86-4c4b-a319-bebaf6984091 req-bc19efb5-4465-4646-9899-3debc663f96f service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Received event network-vif-deleted-32ca459f-0896-46b9-9184-4d9249484eb4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:37:21 user nova-compute[72000]: INFO nova.compute.manager [req-7201603c-2e86-4c4b-a319-bebaf6984091 req-bc19efb5-4465-4646-9899-3debc663f96f service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Neutron deleted interface 32ca459f-0896-46b9-9184-4d9249484eb4; detaching it from the instance and deleting it from the info cache
Aug 16 18:37:21 user nova-compute[72000]: DEBUG nova.network.neutron [req-7201603c-2e86-4c4b-a319-bebaf6984091 req-bc19efb5-4465-4646-9899-3debc663f96f service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:37:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-7201603c-2e86-4c4b-a319-bebaf6984091 req-bc19efb5-4465-4646-9899-3debc663f96f service nova] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Detach interface failed, port_id=32ca459f-0896-46b9-9184-4d9249484eb4, reason: Instance 211a60ff-dd5d-46e2-bc85-087ea248bb63 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:37:21 user nova-compute[72000]: INFO nova.compute.manager [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Took 0.82 seconds to detach 1 volumes for instance.
Aug 16 18:37:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:37:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:37:22 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:37:22 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:37:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:37:22 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Deleted allocations for instance 211a60ff-dd5d-46e2-bc85-087ea248bb63
Aug 16 18:37:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dcb5c226-e4e2-4e5a-bc47-aca370f025b6 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "211a60ff-dd5d-46e2-bc85-087ea248bb63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.771s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:37:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:37:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 71a87e9f-7705-40a5-9ca7-9aca0bbae678 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:37:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:37:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:37:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:37:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:37:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:37:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:37:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:37:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:35 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692211040.1670578, 211a60ff-dd5d-46e2-bc85-087ea248bb63 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:37:35 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] VM Stopped (Lifecycle Event)
Aug 16 18:37:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-efc2895c-6bac-42fd-a69c-7a20b247e23e None None] [instance: 211a60ff-dd5d-46e2-bc85-087ea248bb63] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:37:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:37:38 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:37:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:37:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:37:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:37:44 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:37:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:37:44 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:37:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:37:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:37:44 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:37:44 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 71a87e9f-7705-40a5-9ca7-9aca0bbae678 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updating instance_info_cache with network_info: [{"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:45 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:37:45 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:37:45 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=23.656402587890625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:37:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:37:46 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 71a87e9f-7705-40a5-9ca7-9aca0bbae678 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:37:46 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:37:46 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:37:46 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:37:46 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:37:46 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:37:46 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:37:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:37:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:37:50 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:37:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:37:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:37:52 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:37:53 user nova-compute[72000]: DEBUG nova.compute.manager [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:37:53 user nova-compute[72000]: INFO nova.compute.manager [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] instance snapshotting
Aug 16 18:37:53 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Beginning live snapshot process
Aug 16 18:37:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json -f qcow2 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json -f qcow2 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpufmgsf99/ee17a0cdabe54ce6b866077ccb0aceae.delta 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpufmgsf99/ee17a0cdabe54ce6b866077ccb0aceae.delta 1073741824" returned: 0 in 0.059s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 18:37:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:37:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:37:55 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 18:37:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:37:55 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:37:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpufmgsf99/ee17a0cdabe54ce6b866077ccb0aceae.delta /opt/stack/data/nova/instances/snapshots/tmpufmgsf99/ee17a0cdabe54ce6b866077ccb0aceae {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:37:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpufmgsf99/ee17a0cdabe54ce6b866077ccb0aceae.delta /opt/stack/data/nova/instances/snapshots/tmpufmgsf99/ee17a0cdabe54ce6b866077ccb0aceae" returned: 0 in 0.479s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:37:55 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Snapshot extracted, beginning image upload
Aug 16 18:37:57 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Snapshot image upload complete
Aug 16 18:37:57 user nova-compute[72000]: INFO nova.compute.manager [None req-82985f8a-59c3-4f07-9c05-565a839a490a tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Took 4.84 seconds to snapshot the instance on the hypervisor.
Aug 16 18:38:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:38:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:38:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:38:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:38:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-854a1963-c340-463d-a3de-1c5732b7a7ef req-9164ec3a-efa4-4c00-bf82-ea29b9e956e3 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received event network-changed-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-854a1963-c340-463d-a3de-1c5732b7a7ef req-9164ec3a-efa4-4c00-bf82-ea29b9e956e3 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Refreshing instance network info cache due to event network-changed-d0560bcc-bc28-4729-b76f-d4f4405ef4ab. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-854a1963-c340-463d-a3de-1c5732b7a7ef req-9164ec3a-efa4-4c00-bf82-ea29b9e956e3 service nova] Acquiring lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-854a1963-c340-463d-a3de-1c5732b7a7ef req-9164ec3a-efa4-4c00-bf82-ea29b9e956e3 service nova] Acquired lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG nova.network.neutron [req-854a1963-c340-463d-a3de-1c5732b7a7ef req-9164ec3a-efa4-4c00-bf82-ea29b9e956e3 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Refreshing network info cache for port d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:38:22 user nova-compute[72000]: INFO nova.compute.manager [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Terminating instance
Aug 16 18:38:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG nova.network.neutron [req-854a1963-c340-463d-a3de-1c5732b7a7ef req-9164ec3a-efa4-4c00-bf82-ea29b9e956e3 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updated VIF entry in instance network info cache for port d0560bcc-bc28-4729-b76f-d4f4405ef4ab. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG nova.network.neutron [req-854a1963-c340-463d-a3de-1c5732b7a7ef req-9164ec3a-efa4-4c00-bf82-ea29b9e956e3 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updating instance_info_cache with network_info: [{"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-854a1963-c340-463d-a3de-1c5732b7a7ef req-9164ec3a-efa4-4c00-bf82-ea29b9e956e3 service nova] Releasing lock "refresh_cache-71a87e9f-7705-40a5-9ca7-9aca0bbae678" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:38:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Instance destroyed successfully.
Aug 16 18:38:23 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lazy-loading 'resources' on Instance uuid 71a87e9f-7705-40a5-9ca7-9aca0bbae678 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-954955042',display_name='tempest-TestVolumeBootPattern-server-954955042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-954955042',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeH+TllNmCaPuNZ7ZDpdAZ2U1yxhHMIwYWH0or6u0ayqmt4OfmsSY6sfiU9gIn1F/l5zMGgKThIwo23xAxIFCcQn4sdo8OhcvXWf8ZZRA2WVCiWVqY2ogTDLbuarVcb+A==',key_name='tempest-TestVolumeBootPattern-1231120149',keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:33:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b758c455ec774042967fb617787c1cbd',ramdisk_id='',reservation_id='r-y38f5pet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-109968882',owner_user_name='tempest-TestVolumeBootPattern-109968882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:33:37Z,user_data=None,user_id='1107151852b84f3185157fff0c0f3495',uuid=71a87e9f-7705-40a5-9ca7-9aca0bbae678,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converting VIF {"id": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "address": "fa:16:3e:75:0c:d9", "network": {"id": "730e5d4e-bc72-4333-b64d-9b3a8fecb124", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1351926045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b758c455ec774042967fb617787c1cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0560bcc-bc", "ovs_interfaceid": "d0560bcc-bc28-4729-b76f-d4f4405ef4ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:0c:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0560bcc-bc28-4729-b76f-d4f4405ef4ab,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0560bcc-bc') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_vif [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:0c:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0560bcc-bc28-4729-b76f-d4f4405ef4ab,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0560bcc-bc') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0560bcc-bc, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:38:23 user nova-compute[72000]: INFO os_vif [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:0c:d9,bridge_name='br-int',has_traffic_filtering=True,id=d0560bcc-bc28-4729-b76f-d4f4405ef4ab,network=Network(730e5d4e-bc72-4333-b64d-9b3a8fecb124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0560bcc-bc')
Aug 16 18:38:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TCirloQw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:38:23 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a68815-f093-4fe3-9b6c-5b9ff11962da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b245974e-6c1d-4fec-9a52-d1c52a553de9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:38:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 (non-flash)
Aug 16 18:38:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0082ee7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[71793ea5-64aa-4f6f-8052-16a761b500fd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6d3f6c-98b8-4fb7-aa78-27894f870fbc]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a961bd-cebf-40e7-8fbd-876ecbec5dcb]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1684e6-cb68-45ec-bcbd-3fc8388decab]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd8373e31-47bd805b338cd90b', '/dev/disk/by-id/scsi-23437626438303562', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d8373e31') {{(pid=83463) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39907fa-3587-482e-a132-6bcfea2115ba]: (4, None) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[998a4fc5-6954-405c-8188-e38bf5fd15de]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43e58a-641b-4c73-95a3-2cd6335a122f]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260]
Aug 16 18:38:23 user nova-compute[72000]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9, portal: 172.16.0.220,3260] successful.
Aug 16 18:38:23 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979fa74-d153-4197-bbeb-8703dbcbaee9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[924b69ea-e66b-46ef-908e-35162b1ce999]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] <== disconnect_volume: return (285ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:38:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Deleting instance files /opt/stack/data/nova/instances/71a87e9f-7705-40a5-9ca7-9aca0bbae678_del
Aug 16 18:38:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Deletion of /opt/stack/data/nova/instances/71a87e9f-7705-40a5-9ca7-9aca0bbae678_del complete
Aug 16 18:38:23 user nova-compute[72000]: INFO nova.compute.manager [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 16 18:38:23 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:38:23 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:38:24 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Took 0.60 seconds to deallocate network for instance.
Aug 16 18:38:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received event network-vif-unplugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] Acquiring lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] No waiting events found dispatching network-vif-unplugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received event network-vif-unplugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received event network-vif-plugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] Acquiring lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:38:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] No waiting events found dispatching network-vif-plugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:38:24 user nova-compute[72000]: WARNING nova.compute.manager [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received unexpected event network-vif-plugged-d0560bcc-bc28-4729-b76f-d4f4405ef4ab for instance with vm_state active and task_state deleting.
Aug 16 18:38:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-73f172e9-0ed4-44dd-bd2d-679e3cbf705c req-2515e0fe-baa6-4075-ab6f-76900551aeb5 service nova] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Received event network-vif-deleted-d0560bcc-bc28-4729-b76f-d4f4405ef4ab {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:38:24 user nova-compute[72000]: INFO nova.compute.manager [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Took 0.77 seconds to detach 1 volumes for instance.
Aug 16 18:38:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:38:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:38:25 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:38:25 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:38:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:38:25 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Deleted allocations for instance 71a87e9f-7705-40a5-9ca7-9aca0bbae678
Aug 16 18:38:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3e04ab9a-9824-4936-a042-8b714d3fa316 tempest-TestVolumeBootPattern-109968882 tempest-TestVolumeBootPattern-109968882-project-member] Lock "71a87e9f-7705-40a5-9ca7-9aca0bbae678" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.781s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:38:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:38:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:38:38 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692211103.2036922, 71a87e9f-7705-40a5-9ca7-9aca0bbae678 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:38:38 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] VM Stopped (Lifecycle Event)
Aug 16 18:38:38 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9fd3cb54-ff35-4d36-a9af-7cfef84cde78 None None] [instance: 71a87e9f-7705-40a5-9ca7-9aca0bbae678] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:38:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:38:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:38:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:38:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:38:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:38:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:38:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:38:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:38:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:45 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:38:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:38:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:38:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:38:45 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updating instance_info_cache with network_info: [{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:38:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:38:47 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:38:47 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:38:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8724MB free_disk=23.606536865234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:38:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:38:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:38:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:38:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:38:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:38:47 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:38:47 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:38:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:38:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:38:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:38:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:38:52 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:38:52 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:38:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:38:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:38:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:38:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:38:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:38:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:38:59 user nova-compute[72000]: INFO nova.compute.claims [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Claim successful on node user
Aug 16 18:38:59 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:38:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:38:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:38:59 user nova-compute[72000]: DEBUG nova.policy [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26718511a87349cfa05d63a131cdeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb2848418984c0f8c5f6418555534c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:39:00 user nova-compute[72000]: INFO nova.virt.block_device [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Booting with blank volume at /dev/vda
Aug 16 18:39:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Successfully created port: 067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Successfully updated port: 067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquired lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-2632e94a-4925-414a-b8eb-dae53938772c req-49fff8b4-3338-4376-bfb7-59749b37a2c7 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-changed-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-2632e94a-4925-414a-b8eb-dae53938772c req-49fff8b4-3338-4376-bfb7-59749b37a2c7 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Refreshing instance network info cache due to event network-changed-067f46f9-2823-4340-8889-317e063f7514. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2632e94a-4925-414a-b8eb-dae53938772c req-49fff8b4-3338-4376-bfb7-59749b37a2c7 service nova] Acquiring lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Releasing lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Instance network_info: |[{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2632e94a-4925-414a-b8eb-dae53938772c req-49fff8b4-3338-4376-bfb7-59749b37a2c7 service nova] Acquired lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:39:01 user nova-compute[72000]: DEBUG nova.network.neutron [req-2632e94a-4925-414a-b8eb-dae53938772c req-49fff8b4-3338-4376-bfb7-59749b37a2c7 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Refreshing network info cache for port 067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:39:02 user nova-compute[72000]: DEBUG nova.network.neutron [req-2632e94a-4925-414a-b8eb-dae53938772c req-49fff8b4-3338-4376-bfb7-59749b37a2c7 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updated VIF entry in instance network info cache for port 067f46f9-2823-4340-8889-317e063f7514. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:39:02 user nova-compute[72000]: DEBUG nova.network.neutron [req-2632e94a-4925-414a-b8eb-dae53938772c req-49fff8b4-3338-4376-bfb7-59749b37a2c7 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:39:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2632e94a-4925-414a-b8eb-dae53938772c req-49fff8b4-3338-4376-bfb7-59749b37a2c7 service nova] Releasing lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:39:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG os_brick.utils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d725bd32-8323-4df3-8f8a-987387bf85e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[617653a2-1bcc-437f-ab08-802ff780419d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c06fa4-50e3-4b26-a034-1b5ad8d90658]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9806fe81-96fa-4ec3-a887-8cce71ae3b2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:39:05 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:39:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f9c70e-d789-4a67-a3db-c6ffcef25c06]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG os_brick.utils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:39:05 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating existing volume attachment record: 9f9fcbea-0791-40fd-957d-cb9b730acc57 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:39:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:39:15 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Creating image(s)
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Ensure instance console log exists: /opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Start _get_guest_xml network_info=[{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkHMKDjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d', 'attached_at': '', 'detached_at': '', 'volume_id': '999a768d-e0e6-47d7-af96-8d9bfa931cb1', 'serial': '999a768d-e0e6-47d7-af96-8d9bfa931cb1'}, 'attachment_id': '9f9fcbea-0791-40fd-957d-cb9b730acc57', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:39:15 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:39:15 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkHMKDjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:39:15 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:39:15 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:39:15 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d42801f-3de2-47da-b207-35c6159b0cbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:39:15 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb25d7c-9b39-4bf5-aeb7-2aa3a804b5d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1] added
Aug 16 18:39:15 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[41deb5e8-dff9-4081-807d-154417f28976]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75a028a-d1ee-4196-b521-de8aae574f61]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkHMKDjx {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkHMKDjx" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[280d181f-1e3a-4501-a95d-0437b8468033]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QkHMKDjx'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d51a7d6-9427-47b3-a337-07b7bfa22244]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b1c6c2-be2c-4300-96f2-fffe20da0a28]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:39:15 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:39:15 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 18:39:15 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:39:15 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 18:39:15 user nova-compute[72000]: 
Aug 16 18:39:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --login" returned: 0 in 1.054s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[390da797-dd25-4a81-9372-503e0c7383e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1, portal: 172.16.0.220,3260]
Aug 16 18:39:16 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1, portal: 172.16.0.220,3260] successful.
Aug 16 18:39:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0433a25-c94f-43ec-be2e-dea8395cc930]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7392c50-3775-40a4-b5b0-08e2c102fc2c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:39:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:39:16 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.261s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8695d04-6c00-48f8-b2e0-1d8e5d1ca418]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:39:16 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkHMKDjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.295s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] <== connect_volume: return (2297ms) {'type': 'block', 'scsi_wwn': '23435633766643736', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435633766643736', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-624288220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-624288220',id=45,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-zhi3p01c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:39:00Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:fe:2d,bridge_name='br-int',has_traffic_filtering=True,id=067f46f9-2823-4340-8889-317e063f7514,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067f46f9-28') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'pci_devices' on Instance uuid c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:39:17 user nova-compute[72000]:   <uuid>c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d</uuid>
Aug 16 18:39:17 user nova-compute[72000]:   <name>instance-0000002d</name>
Aug 16 18:39:17 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:39:17 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:39:17 user nova-compute[72000]:   <metadata>
Aug 16 18:39:17 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:39:17 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:39:17 user nova-compute[72000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-624288220</nova:name>
Aug 16 18:39:17 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:39:15</nova:creationTime>
Aug 16 18:39:17 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:39:17 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:39:17 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:39:17 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:39:17 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:39:17 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:39:17 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:39:17 user nova-compute[72000]:       <nova:owner>
Aug 16 18:39:17 user nova-compute[72000]:         <nova:user uuid="26718511a87349cfa05d63a131cdeafa">tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member</nova:user>
Aug 16 18:39:17 user nova-compute[72000]:         <nova:project uuid="efb2848418984c0f8c5f6418555534c5">tempest-ServerBootFromVolumeStableRescueTest-761401575</nova:project>
Aug 16 18:39:17 user nova-compute[72000]:       </nova:owner>
Aug 16 18:39:17 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:39:17 user nova-compute[72000]:       <nova:ports>
Aug 16 18:39:17 user nova-compute[72000]:         <nova:port uuid="067f46f9-2823-4340-8889-317e063f7514">
Aug 16 18:39:17 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 18:39:17 user nova-compute[72000]:         </nova:port>
Aug 16 18:39:17 user nova-compute[72000]:       </nova:ports>
Aug 16 18:39:17 user nova-compute[72000]:     </nova:instance>
Aug 16 18:39:17 user nova-compute[72000]:   </metadata>
Aug 16 18:39:17 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:39:17 user nova-compute[72000]:     <system>
Aug 16 18:39:17 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:39:17 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:39:17 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:39:17 user nova-compute[72000]:       <entry name="serial">c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d</entry>
Aug 16 18:39:17 user nova-compute[72000]:       <entry name="uuid">c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d</entry>
Aug 16 18:39:17 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:39:17 user nova-compute[72000]:     </system>
Aug 16 18:39:17 user nova-compute[72000]:   </sysinfo>
Aug 16 18:39:17 user nova-compute[72000]:   <os>
Aug 16 18:39:17 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:39:17 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:39:17 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:39:17 user nova-compute[72000]:   </os>
Aug 16 18:39:17 user nova-compute[72000]:   <features>
Aug 16 18:39:17 user nova-compute[72000]:     <acpi/>
Aug 16 18:39:17 user nova-compute[72000]:     <apic/>
Aug 16 18:39:17 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:39:17 user nova-compute[72000]:   </features>
Aug 16 18:39:17 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:39:17 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:39:17 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:39:17 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:39:17 user nova-compute[72000]:   </clock>
Aug 16 18:39:17 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:39:17 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:39:17 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:39:17 user nova-compute[72000]:   </cpu>
Aug 16 18:39:17 user nova-compute[72000]:   <devices>
Aug 16 18:39:17 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:39:17 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:39:17 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 18:39:17 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:39:17 user nova-compute[72000]:       <serial>999a768d-e0e6-47d7-af96-8d9bfa931cb1</serial>
Aug 16 18:39:17 user nova-compute[72000]:     </disk>
Aug 16 18:39:17 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:39:17 user nova-compute[72000]:       <mac address="fa:16:3e:a2:fe:2d"/>
Aug 16 18:39:17 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:39:17 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:39:17 user nova-compute[72000]:       <target dev="tap067f46f9-28"/>
Aug 16 18:39:17 user nova-compute[72000]:     </interface>
Aug 16 18:39:17 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:39:17 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/console.log" append="off"/>
Aug 16 18:39:17 user nova-compute[72000]:     </serial>
Aug 16 18:39:17 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:39:17 user nova-compute[72000]:     <video>
Aug 16 18:39:17 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:39:17 user nova-compute[72000]:     </video>
Aug 16 18:39:17 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:39:17 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:39:17 user nova-compute[72000]:     </rng>
Aug 16 18:39:17 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:39:17 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:39:17 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:39:17 user nova-compute[72000]:     </memballoon>
Aug 16 18:39:17 user nova-compute[72000]:   </devices>
Aug 16 18:39:17 user nova-compute[72000]: </domain>
Aug 16 18:39:17 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-624288220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-624288220',id=45,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-zhi3p01c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:39:00Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:fe:2d,bridge_name='br-int',has_traffic_filtering=True,id=067f46f9-2823-4340-8889-317e063f7514,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067f46f9-28') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG os_vif [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:fe:2d,bridge_name='br-int',has_traffic_filtering=True,id=067f46f9-2823-4340-8889-317e063f7514,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067f46f9-28') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap067f46f9-28, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap067f46f9-28, col_values=(('external_ids', {'iface-id': '067f46f9-2823-4340-8889-317e063f7514', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:fe:2d', 'vm-uuid': 'c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:17 user nova-compute[72000]: INFO os_vif [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:fe:2d,bridge_name='br-int',has_traffic_filtering=True,id=067f46f9-2823-4340-8889-317e063f7514,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067f46f9-28')
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:39:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No VIF found with MAC fa:16:3e:a2:fe:2d, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:39:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-ba7ba582-0a71-4950-9867-494477e981ae req-e011ca8a-1c62-4e69-97a1-4af96b66e1b0 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:39:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ba7ba582-0a71-4950-9867-494477e981ae req-e011ca8a-1c62-4e69-97a1-4af96b66e1b0 service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:39:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ba7ba582-0a71-4950-9867-494477e981ae req-e011ca8a-1c62-4e69-97a1-4af96b66e1b0 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:39:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ba7ba582-0a71-4950-9867-494477e981ae req-e011ca8a-1c62-4e69-97a1-4af96b66e1b0 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:39:19 user nova-compute[72000]: DEBUG nova.compute.manager [req-ba7ba582-0a71-4950-9867-494477e981ae req-e011ca8a-1c62-4e69-97a1-4af96b66e1b0 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:39:19 user nova-compute[72000]: WARNING nova.compute.manager [req-ba7ba582-0a71-4950-9867-494477e981ae req-e011ca8a-1c62-4e69-97a1-4af96b66e1b0 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state building and task_state spawning.
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211161.4058936, c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:39:21 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] VM Resumed (Lifecycle Event)
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:39:21 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Instance spawned successfully.
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:39:21 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211161.4074228, c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:39:21 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] VM Started (Lifecycle Event)
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:39:21 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:39:21 user nova-compute[72000]: INFO nova.compute.manager [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-921a899c-736d-4a59-9eda-1633fbae85fa req-a7495257-a2b7-4d0a-9018-afc56fccc3d7 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-921a899c-736d-4a59-9eda-1633fbae85fa req-a7495257-a2b7-4d0a-9018-afc56fccc3d7 service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-921a899c-736d-4a59-9eda-1633fbae85fa req-a7495257-a2b7-4d0a-9018-afc56fccc3d7 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-921a899c-736d-4a59-9eda-1633fbae85fa req-a7495257-a2b7-4d0a-9018-afc56fccc3d7 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:39:21 user nova-compute[72000]: DEBUG nova.compute.manager [req-921a899c-736d-4a59-9eda-1633fbae85fa req-a7495257-a2b7-4d0a-9018-afc56fccc3d7 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:39:21 user nova-compute[72000]: WARNING nova.compute.manager [req-921a899c-736d-4a59-9eda-1633fbae85fa req-a7495257-a2b7-4d0a-9018-afc56fccc3d7 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state building and task_state spawning.
Aug 16 18:39:21 user nova-compute[72000]: INFO nova.compute.manager [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Took 22.03 seconds to build instance.
Aug 16 18:39:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f6d982fd-57ae-4739-9455-6aae5c421c48 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.123s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:39:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:39:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:39:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:39:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:39:41 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:39:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:46 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:39:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:39:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:39:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:39:46 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:39:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:39:47 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:39:47 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:39:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=23.60421371459961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:39:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:39:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:39:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:39:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:39:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:39:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:39:48 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:39:48 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:39:49 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updating instance_info_cache with network_info: [{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:39:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:39:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:39:50 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:39:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:39:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:39:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:39:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:39:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:40:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:40:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:40:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:40:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:40:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:40:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:40:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:40:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:40:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:40:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:40:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:40:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:40:41 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:40:41 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:40:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:43 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:40:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:40:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:40:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:40:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:40:47 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:40:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:40:49 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:40:49 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:40:49 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=23.603626251220703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:40:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:40:50 user nova-compute[72000]: INFO nova.compute.manager [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Rescuing
Aug 16 18:40:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:40:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquired lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:40:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:40:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:40:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Releasing lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-59cb0e42-600b-402f-be23-58db31dfed34 req-dad6fe78-fd06-4bcf-bfcb-eb36fd8562e1 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-unplugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-59cb0e42-600b-402f-be23-58db31dfed34 req-dad6fe78-fd06-4bcf-bfcb-eb36fd8562e1 service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-59cb0e42-600b-402f-be23-58db31dfed34 req-dad6fe78-fd06-4bcf-bfcb-eb36fd8562e1 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-59cb0e42-600b-402f-be23-58db31dfed34 req-dad6fe78-fd06-4bcf-bfcb-eb36fd8562e1 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-59cb0e42-600b-402f-be23-58db31dfed34 req-dad6fe78-fd06-4bcf-bfcb-eb36fd8562e1 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-unplugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:40:51 user nova-compute[72000]: WARNING nova.compute.manager [req-59cb0e42-600b-402f-be23-58db31dfed34 req-dad6fe78-fd06-4bcf-bfcb-eb36fd8562e1 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-unplugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state active and task_state rescuing.
Aug 16 18:40:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Instance destroyed successfully.
Aug 16 18:40:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Attempting a stable device rescue
Aug 16 18:40:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Instance directory exists: not creating {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 18:40:51 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Creating image(s)
Aug 16 18:40:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "/opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "/opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "/opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'trusted_certs' on Instance uuid c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "04fb3f99df5ce85ba29b2dab08292a887ef4aff3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:40:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "04fb3f99df5ce85ba29b2dab08292a887ef4aff3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:40:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3.part --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3.part --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:52 user nova-compute[72000]: DEBUG nova.virt.images [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] 1cd013ef-7b6f-4176-9714-0c44ff6c6249 was qcow2, converting to raw {{(pid=72000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 18:40:52 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:40:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3.part /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3.converted {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-4ddd08d8-fd5d-42de-ae80-dfc60807f31c req-a2b6eec6-b444-4ca9-b5ef-c287c119a2a5 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4ddd08d8-fd5d-42de-ae80-dfc60807f31c req-a2b6eec6-b444-4ca9-b5ef-c287c119a2a5 service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4ddd08d8-fd5d-42de-ae80-dfc60807f31c req-a2b6eec6-b444-4ca9-b5ef-c287c119a2a5 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4ddd08d8-fd5d-42de-ae80-dfc60807f31c req-a2b6eec6-b444-4ca9-b5ef-c287c119a2a5 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-4ddd08d8-fd5d-42de-ae80-dfc60807f31c req-a2b6eec6-b444-4ca9-b5ef-c287c119a2a5 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:40:53 user nova-compute[72000]: WARNING nova.compute.manager [req-4ddd08d8-fd5d-42de-ae80-dfc60807f31c req-a2b6eec6-b444-4ca9-b5ef-c287c119a2a5 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state active and task_state rescuing.
Aug 16 18:40:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3.part /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3.converted" returned: 0 in 0.680s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3.converted --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "04fb3f99df5ce85ba29b2dab08292a887ef4aff3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "04fb3f99df5ce85ba29b2dab08292a887ef4aff3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "04fb3f99df5ce85ba29b2dab08292a887ef4aff3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:40:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3 --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3,backing_fmt=raw /opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/disk.rescue {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3,backing_fmt=raw /opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/disk.rescue" returned: 0 in 0.047s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "04fb3f99df5ce85ba29b2dab08292a887ef4aff3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'migration_context' on Instance uuid c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Start _get_guest_xml network_info=[{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "vif_mac": "fa:16:3e:a2:fe:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1cd013ef-7b6f-4176-9714-0c44ff6c6249', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkHMKDjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d', 'attached_at': '', 'detached_at': '', 'volume_id': '999a768d-e0e6-47d7-af96-8d9bfa931cb1', 'serial': '999a768d-e0e6-47d7-af96-8d9bfa931cb1'}, 'attachment_id': '9f9fcbea-0791-40fd-957d-cb9b730acc57', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'resources' on Instance uuid c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'numa_topology' on Instance uuid c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:40:54 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:40:54 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'vcpu_model' on Instance uuid c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkHMKDjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:40:54 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:40:54 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:40:54 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d504b7-7123-4b84-9131-886e33afc2ab]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QkHMKDjx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 18:40:54 user nova-compute[72000]: node.name = iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1
Aug 16 18:40:54 user nova-compute[72000]: node.tpgt = -1
Aug 16 18:40:54 user nova-compute[72000]: node.startup = automatic
Aug 16 18:40:54 user nova-compute[72000]: node.leading_login = No
Aug 16 18:40:54 user nova-compute[72000]: iface.iscsi_ifacename = default
Aug 16 18:40:54 user nova-compute[72000]: iface.net_ifacename = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.ipaddress = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.prefix_len = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.hwaddress = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.transport_name = tcp
Aug 16 18:40:54 user nova-compute[72000]: iface.initiatorname = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.state = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.vlan_id = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.vlan_priority = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.vlan_state = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.iface_num = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.mtu = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.port = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.bootproto = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.subnet_mask = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.gateway = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.dhcp_alt_client_id = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.dhcp_dns = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.dhcp_learn_iqn = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.dhcp_vendor_id_state = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.dhcp_vendor_id = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.dhcp_slp_da = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.fragmentation = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.gratuitous_arp = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.incoming_forwarding = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.tos_state = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.tos = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.ttl = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.delayed_ack = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.tcp_nagle = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.tcp_wsf_state = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.tcp_wsf = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.tcp_timer_scale = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.tcp_timestamp = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.redirect = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.def_task_mgmt_timeout = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.header_digest = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.data_digest = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.immediate_data = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.initial_r2t = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.data_seq_inorder = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.data_pdu_inorder = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.erl = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.max_receive_data_len = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.first_burst_len = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.max_outstanding_r2t = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.max_burst_len = 0
Aug 16 18:40:54 user nova-compute[72000]: iface.chap_auth = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.bidi_chap = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.strict_login_compliance = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.discovery_auth = <empty>
Aug 16 18:40:54 user nova-compute[72000]: iface.discovery_logout = <empty>
Aug 16 18:40:54 user nova-compute[72000]: node.discovery_address = <empty>
Aug 16 18:40:54 user nova-compute[72000]: node.discovery_port = 0
Aug 16 18:40:54 user nova-compute[72000]: node.discovery_type = static
Aug 16 18:40:54 user nova-compute[72000]: node.session.initial_cmdsn = 0
Aug 16 18:40:54 user nova-compute[72000]: node.session.initial_login_retry_max = 8
Aug 16 18:40:54 user nova-compute[72000]: node.session.xmit_thread_priority = -20
Aug 16 18:40:54 user nova-compute[72000]: node.session.cmds_max = 128
Aug 16 18:40:54 user nova-compute[72000]: node.session.queue_depth = 32
Aug 16 18:40:54 user nova-compute[72000]: node.session.nr_sessions = 1
Aug 16 18:40:54 user nova-compute[72000]: node.session.auth.authmethod = CHAP
Aug 16 18:40:54 user nova-compute[72000]: node.session.auth.username = QkHMKDjx
Aug 16 18:40:54 user nova-compute[72000]: node.session.auth.password = ***
Aug 16 18:40:54 user nova-compute[72000]: node.session.auth.username_in = <empty>
Aug 16 18:40:54 user nova-compute[72000]: node.session.auth.password_in = <empty>
Aug 16 18:40:54 user nova-compute[72000]: node.session.auth.chap_algs = MD5
Aug 16 18:40:54 user nova-compute[72000]: node.session.timeo.replacement_timeout = 120
Aug 16 18:40:54 user nova-compute[72000]: node.session.err_timeo.abort_timeout = 15
Aug 16 18:40:54 user nova-compute[72000]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 18:40:54 user nova-compute[72000]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 18:40:54 user nova-compute[72000]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 18:40:54 user nova-compute[72000]: node.session.iscsi.FastAbort = Yes
Aug 16 18:40:54 user nova-compute[72000]: node.session.iscsi.InitialR2T = No
Aug 16 18:40:54 user nova-compute[72000]: node.session.iscsi.ImmediateData = Yes
Aug 16 18:40:54 user nova-compute[72000]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 18:40:54 user nova-compute[72000]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 18:40:54 user nova-compute[72000]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 18:40:54 user nova-compute[72000]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 18:40:54 user nova-compute[72000]: node.session.iscsi.MaxConnections = 1
Aug 16 18:40:54 user nova-compute[72000]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 18:40:54 user nova-compute[72000]: node.session.iscsi.ERL = 0
Aug 16 18:40:54 user nova-compute[72000]: node.session.scan = manual
Aug 16 18:40:54 user nova-compute[72000]: node.session.reopen_max = 0
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].address = 172.16.0.220
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].port = 3260
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].startup = manual
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].tcp.window_size = 524288
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].tcp.type_of_service = 0
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].timeo.logout_timeout = 15
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].timeo.login_timeout = 15
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].timeo.auth_timeout = 45
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].iscsi.DataDigest = None
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].iscsi.IFMarker = No
Aug 16 18:40:54 user nova-compute[72000]: node.conn[0].iscsi.OFMarker = No
Aug 16 18:40:54 user nova-compute[72000]: # END RECORD
Aug 16 18:40:54 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5762bd02-2a94-41f3-82de-c13b2f921383]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[98157286-8a00-4d59-b05b-f609f73f7755]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkHMKDjx {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkHMKDjx" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[636741d7-352e-4edf-ad51-db1626e1e682]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QkHMKDjx'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a700feaf-37a1-4666-9603-85e6e35d5fcc]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[be806785-662d-4aa0-959f-4de66f1f5296]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:40:54 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:40:54 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] HCTL ('33', '0', '0', 0) found on session 56 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2b4784-0879-4b00-9d05-c8b35df5879c]: (4, ('0 0 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching for a device in session 56 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkHMKDjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] <== connect_volume: return (165ms) {'type': 'block', 'scsi_wwn': '23435633766643736', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435633766643736', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-624288220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-624288220',id=45,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-zhi3p01c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:39:22Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "vif_mac": "fa:16:3e:a2:fe:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "vif_mac": "fa:16:3e:a2:fe:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:fe:2d,bridge_name='br-int',has_traffic_filtering=True,id=067f46f9-2823-4340-8889-317e063f7514,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067f46f9-28') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'pci_devices' on Instance uuid c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:40:54 user nova-compute[72000]:   <uuid>c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d</uuid>
Aug 16 18:40:54 user nova-compute[72000]:   <name>instance-0000002d</name>
Aug 16 18:40:54 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:40:54 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:40:54 user nova-compute[72000]:   <metadata>
Aug 16 18:40:54 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:40:54 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:40:54 user nova-compute[72000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-624288220</nova:name>
Aug 16 18:40:54 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:40:54</nova:creationTime>
Aug 16 18:40:54 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:40:54 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:40:54 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:40:54 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:40:54 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:40:54 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:40:54 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:40:54 user nova-compute[72000]:       <nova:owner>
Aug 16 18:40:54 user nova-compute[72000]:         <nova:user uuid="26718511a87349cfa05d63a131cdeafa">tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member</nova:user>
Aug 16 18:40:54 user nova-compute[72000]:         <nova:project uuid="efb2848418984c0f8c5f6418555534c5">tempest-ServerBootFromVolumeStableRescueTest-761401575</nova:project>
Aug 16 18:40:54 user nova-compute[72000]:       </nova:owner>
Aug 16 18:40:54 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:40:54 user nova-compute[72000]:       <nova:ports>
Aug 16 18:40:54 user nova-compute[72000]:         <nova:port uuid="067f46f9-2823-4340-8889-317e063f7514">
Aug 16 18:40:54 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 16 18:40:54 user nova-compute[72000]:         </nova:port>
Aug 16 18:40:54 user nova-compute[72000]:       </nova:ports>
Aug 16 18:40:54 user nova-compute[72000]:     </nova:instance>
Aug 16 18:40:54 user nova-compute[72000]:   </metadata>
Aug 16 18:40:54 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:40:54 user nova-compute[72000]:     <system>
Aug 16 18:40:54 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:40:54 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:40:54 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:40:54 user nova-compute[72000]:       <entry name="serial">c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d</entry>
Aug 16 18:40:54 user nova-compute[72000]:       <entry name="uuid">c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d</entry>
Aug 16 18:40:54 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:40:54 user nova-compute[72000]:     </system>
Aug 16 18:40:54 user nova-compute[72000]:   </sysinfo>
Aug 16 18:40:54 user nova-compute[72000]:   <os>
Aug 16 18:40:54 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:40:54 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:40:54 user nova-compute[72000]:   </os>
Aug 16 18:40:54 user nova-compute[72000]:   <features>
Aug 16 18:40:54 user nova-compute[72000]:     <acpi/>
Aug 16 18:40:54 user nova-compute[72000]:     <apic/>
Aug 16 18:40:54 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:40:54 user nova-compute[72000]:   </features>
Aug 16 18:40:54 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:40:54 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:40:54 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:40:54 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:40:54 user nova-compute[72000]:   </clock>
Aug 16 18:40:54 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:40:54 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:40:54 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:40:54 user nova-compute[72000]:   </cpu>
Aug 16 18:40:54 user nova-compute[72000]:   <devices>
Aug 16 18:40:54 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:40:54 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:40:54 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 18:40:54 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:40:54 user nova-compute[72000]:       <serial>999a768d-e0e6-47d7-af96-8d9bfa931cb1</serial>
Aug 16 18:40:54 user nova-compute[72000]:     </disk>
Aug 16 18:40:54 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:40:54 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:40:54 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/disk.rescue"/>
Aug 16 18:40:54 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:40:54 user nova-compute[72000]:       <boot order="1"/>
Aug 16 18:40:54 user nova-compute[72000]:     </disk>
Aug 16 18:40:54 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:40:54 user nova-compute[72000]:       <mac address="fa:16:3e:a2:fe:2d"/>
Aug 16 18:40:54 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:40:54 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:40:54 user nova-compute[72000]:       <target dev="tap067f46f9-28"/>
Aug 16 18:40:54 user nova-compute[72000]:     </interface>
Aug 16 18:40:54 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:40:54 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/console.log" append="off"/>
Aug 16 18:40:54 user nova-compute[72000]:     </serial>
Aug 16 18:40:54 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:40:54 user nova-compute[72000]:     <video>
Aug 16 18:40:54 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:40:54 user nova-compute[72000]:     </video>
Aug 16 18:40:54 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:40:54 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:40:54 user nova-compute[72000]:     </rng>
Aug 16 18:40:54 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:40:54 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:40:54 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:40:54 user nova-compute[72000]:     </memballoon>
Aug 16 18:40:54 user nova-compute[72000]:   </devices>
Aug 16 18:40:54 user nova-compute[72000]: </domain>
Aug 16 18:40:54 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:40:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Instance destroyed successfully.
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No VIF found with MAC fa:16:3e:a2:fe:2d, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:40:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:40:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:56 user nova-compute[72000]: DEBUG nova.compute.manager [req-eb3aad30-19fb-4762-9bad-06fdc4e429bd req-1b546b50-2150-4479-9400-2d1b2d272b16 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:40:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-eb3aad30-19fb-4762-9bad-06fdc4e429bd req-1b546b50-2150-4479-9400-2d1b2d272b16 service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:40:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-eb3aad30-19fb-4762-9bad-06fdc4e429bd req-1b546b50-2150-4479-9400-2d1b2d272b16 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:40:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-eb3aad30-19fb-4762-9bad-06fdc4e429bd req-1b546b50-2150-4479-9400-2d1b2d272b16 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:40:56 user nova-compute[72000]: DEBUG nova.compute.manager [req-eb3aad30-19fb-4762-9bad-06fdc4e429bd req-1b546b50-2150-4479-9400-2d1b2d272b16 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:40:56 user nova-compute[72000]: WARNING nova.compute.manager [req-eb3aad30-19fb-4762-9bad-06fdc4e429bd req-1b546b50-2150-4479-9400-2d1b2d272b16 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state active and task_state rescuing.
Aug 16 18:40:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:40:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:40:57 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211257.829251, c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:40:57 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] VM Resumed (Lifecycle Event)
Aug 16 18:40:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-0019637e-886f-40e8-b32c-808c6131a025 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:40:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:40:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:40:57 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 18:40:57 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211257.8320217, c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:40:57 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] VM Started (Lifecycle Event)
Aug 16 18:40:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:40:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:40:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:40:58 user nova-compute[72000]: DEBUG nova.compute.manager [req-33b50cb8-3fef-4f2a-b666-eac01fe92bb4 req-c8cf9d4e-cd53-4103-8289-b127dd61dd19 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:40:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-33b50cb8-3fef-4f2a-b666-eac01fe92bb4 req-c8cf9d4e-cd53-4103-8289-b127dd61dd19 service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:40:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-33b50cb8-3fef-4f2a-b666-eac01fe92bb4 req-c8cf9d4e-cd53-4103-8289-b127dd61dd19 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:40:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-33b50cb8-3fef-4f2a-b666-eac01fe92bb4 req-c8cf9d4e-cd53-4103-8289-b127dd61dd19 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:40:58 user nova-compute[72000]: DEBUG nova.compute.manager [req-33b50cb8-3fef-4f2a-b666-eac01fe92bb4 req-c8cf9d4e-cd53-4103-8289-b127dd61dd19 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:40:58 user nova-compute[72000]: WARNING nova.compute.manager [req-33b50cb8-3fef-4f2a-b666-eac01fe92bb4 req-c8cf9d4e-cd53-4103-8289-b127dd61dd19 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state rescued and task_state None.
Aug 16 18:40:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:41:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:41:41 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:41:42 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:41:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:41:44 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:41:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:41:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:41:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:41:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:41:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:41:48 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:41:48 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updating instance_info_cache with network_info: [{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:41:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:41:50 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:41:50 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=23.498939514160156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:41:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:41:52 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:41:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:41:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:41:56 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:41:57 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:41:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:41:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:41:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:41:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:41:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:41:58 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:42:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:42:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:42:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:42:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:42:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:42:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:42:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:42:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:42:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:42:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:42:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:42:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:42:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:42:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:42:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:41 user nova-compute[72000]: INFO nova.compute.manager [None req-84442602-3893-4bc4-8aba-beee4ed0f8c6 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Unrescuing
Aug 16 18:42:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-84442602-3893-4bc4-8aba-beee4ed0f8c6 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:42:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-84442602-3893-4bc4-8aba-beee4ed0f8c6 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquired lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:42:41 user nova-compute[72000]: DEBUG nova.network.neutron [None req-84442602-3893-4bc4-8aba-beee4ed0f8c6 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:42:41 user nova-compute[72000]: DEBUG nova.network.neutron [None req-84442602-3893-4bc4-8aba-beee4ed0f8c6 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:42:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-84442602-3893-4bc4-8aba-beee4ed0f8c6 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Releasing lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:42:41 user nova-compute[72000]: DEBUG nova.objects.instance [None req-84442602-3893-4bc4-8aba-beee4ed0f8c6 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'flavor' on Instance uuid c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:42:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-901141b9-1989-4d18-af25-e862f0adeaa4 req-27734d5f-4c83-41fd-a31c-d39f8ed8a380 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-unplugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:42:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-901141b9-1989-4d18-af25-e862f0adeaa4 req-27734d5f-4c83-41fd-a31c-d39f8ed8a380 service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:42:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-901141b9-1989-4d18-af25-e862f0adeaa4 req-27734d5f-4c83-41fd-a31c-d39f8ed8a380 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:42:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-901141b9-1989-4d18-af25-e862f0adeaa4 req-27734d5f-4c83-41fd-a31c-d39f8ed8a380 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:42:42 user nova-compute[72000]: DEBUG nova.compute.manager [req-901141b9-1989-4d18-af25-e862f0adeaa4 req-27734d5f-4c83-41fd-a31c-d39f8ed8a380 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-unplugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:42:42 user nova-compute[72000]: WARNING nova.compute.manager [req-901141b9-1989-4d18-af25-e862f0adeaa4 req-27734d5f-4c83-41fd-a31c-d39f8ed8a380 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-unplugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:42:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:42 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Instance destroyed successfully.
Aug 16 18:42:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:43 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:43 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:42:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:42:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:42:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:42:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:42:44 user nova-compute[72000]: WARNING nova.compute.manager [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:42:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:42:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:42:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:42:44 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:42:44 user nova-compute[72000]: DEBUG nova.compute.manager [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:42:44 user nova-compute[72000]: WARNING nova.compute.manager [req-22cdcc78-f3ac-43d5-8116-1fecf5df8c28 req-99a8a3b5-e9c9-4fa4-882b-1111d0e3e353 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:42:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:45 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:42:45 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211365.9828854, c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:42:45 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] VM Resumed (Lifecycle Event)
Aug 16 18:42:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-84442602-3893-4bc4-8aba-beee4ed0f8c6 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:42:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:42:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:42:46 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 18:42:46 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211365.9841828, c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:42:46 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] VM Started (Lifecycle Event)
Aug 16 18:42:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:42:46 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:42:46 user nova-compute[72000]: DEBUG nova.compute.manager [req-3a215046-9ec3-413a-8813-ab69702b71b4 req-1f68e168-c0aa-46eb-8851-b2fd627971e4 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:42:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3a215046-9ec3-413a-8813-ab69702b71b4 req-1f68e168-c0aa-46eb-8851-b2fd627971e4 service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:42:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3a215046-9ec3-413a-8813-ab69702b71b4 req-1f68e168-c0aa-46eb-8851-b2fd627971e4 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:42:46 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-3a215046-9ec3-413a-8813-ab69702b71b4 req-1f68e168-c0aa-46eb-8851-b2fd627971e4 service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:42:46 user nova-compute[72000]: DEBUG nova.compute.manager [req-3a215046-9ec3-413a-8813-ab69702b71b4 req-1f68e168-c0aa-46eb-8851-b2fd627971e4 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:42:46 user nova-compute[72000]: WARNING nova.compute.manager [req-3a215046-9ec3-413a-8813-ab69702b71b4 req-1f68e168-c0aa-46eb-8851-b2fd627971e4 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state active and task_state None.
Aug 16 18:42:46 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:50 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:42:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:42:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:42:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:42:51 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:42:51 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:42:51 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=23.499114990234375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:42:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:42:52 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:42:52 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:42:52 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:42:52 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:42:52 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:42:52 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:42:52 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:42:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:42:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:42:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:42:58 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:42:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:42:59 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:43:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:43:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:43:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:43:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:43:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:43:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:43:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:43:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:43:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:43:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:43:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:43:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:43:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:42 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:43:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:43:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:43:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:43:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:43:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:43 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:43:44 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:43:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:43:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:50 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:43:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:43:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:43:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:43:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:43:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:43:50 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:43:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updating instance_info_cache with network_info: [{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:43:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:43:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:43:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:43:52 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:43:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:43:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:43:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:43:52 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:43:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:43:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:43:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:43:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:43:53 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:43:53 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:43:53 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=23.49856185913086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:43:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:43:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:43:58 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:43:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:44:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:44:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:44:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:44:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:44:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:44:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:44:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:44:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:44:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:44:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:44:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "3ac42bf3-8ecd-497e-8224-cb586ad57088" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:44:33 user nova-compute[72000]: INFO nova.compute.claims [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Claim successful on node user
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:44:33 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.policy [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26718511a87349cfa05d63a131cdeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb2848418984c0f8c5f6418555534c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:44:33 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Creating image(s)
Aug 16 18:44:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:44:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "/opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "/opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk 1073741824" returned: 0 in 0.051s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG nova.network.neutron [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Successfully created port: 6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.187s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Cannot resize image /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG nova.objects.instance [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'migration_context' on Instance uuid 3ac42bf3-8ecd-497e-8224-cb586ad57088 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Ensure instance console log exists: /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:44:34 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Successfully updated port: 6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquired lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-49a0cddd-32d4-4882-8fef-191f8c8e2227 req-3c2e370f-f6d1-4565-ac1b-321c002bb3c4 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Received event network-changed-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.compute.manager [req-49a0cddd-32d4-4882-8fef-191f8c8e2227 req-3c2e370f-f6d1-4565-ac1b-321c002bb3c4 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Refreshing instance network info cache due to event network-changed-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-49a0cddd-32d4-4882-8fef-191f8c8e2227 req-3c2e370f-f6d1-4565-ac1b-321c002bb3c4 service nova] Acquiring lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.network.neutron [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Updating instance_info_cache with network_info: [{"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Releasing lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.compute.manager [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Instance network_info: |[{"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-49a0cddd-32d4-4882-8fef-191f8c8e2227 req-3c2e370f-f6d1-4565-ac1b-321c002bb3c4 service nova] Acquired lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.network.neutron [req-49a0cddd-32d4-4882-8fef-191f8c8e2227 req-3c2e370f-f6d1-4565-ac1b-321c002bb3c4 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Refreshing network info cache for port 6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Start _get_guest_xml network_info=[{"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:44:35 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:44:35 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:44:35 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:44:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1887245521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1887245521',id=46,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-7sczevw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:44:34Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=3ac42bf3-8ecd-497e-8224-cb586ad57088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:31:d6,bridge_name='br-int',has_traffic_filtering=True,id=6e8f6cc2-37ad-4af2-b1ca-1bf306579a09,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8f6cc2-37') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.objects.instance [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ac42bf3-8ecd-497e-8224-cb586ad57088 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:44:36 user nova-compute[72000]:   <uuid>3ac42bf3-8ecd-497e-8224-cb586ad57088</uuid>
Aug 16 18:44:36 user nova-compute[72000]:   <name>instance-0000002e</name>
Aug 16 18:44:36 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:44:36 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:44:36 user nova-compute[72000]:   <metadata>
Aug 16 18:44:36 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:44:36 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:44:36 user nova-compute[72000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1887245521</nova:name>
Aug 16 18:44:36 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:44:35</nova:creationTime>
Aug 16 18:44:36 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:44:36 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:44:36 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:44:36 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:44:36 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:44:36 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:44:36 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:44:36 user nova-compute[72000]:       <nova:owner>
Aug 16 18:44:36 user nova-compute[72000]:         <nova:user uuid="26718511a87349cfa05d63a131cdeafa">tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member</nova:user>
Aug 16 18:44:36 user nova-compute[72000]:         <nova:project uuid="efb2848418984c0f8c5f6418555534c5">tempest-ServerBootFromVolumeStableRescueTest-761401575</nova:project>
Aug 16 18:44:36 user nova-compute[72000]:       </nova:owner>
Aug 16 18:44:36 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:44:36 user nova-compute[72000]:       <nova:ports>
Aug 16 18:44:36 user nova-compute[72000]:         <nova:port uuid="6e8f6cc2-37ad-4af2-b1ca-1bf306579a09">
Aug 16 18:44:36 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 16 18:44:36 user nova-compute[72000]:         </nova:port>
Aug 16 18:44:36 user nova-compute[72000]:       </nova:ports>
Aug 16 18:44:36 user nova-compute[72000]:     </nova:instance>
Aug 16 18:44:36 user nova-compute[72000]:   </metadata>
Aug 16 18:44:36 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:44:36 user nova-compute[72000]:     <system>
Aug 16 18:44:36 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:44:36 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:44:36 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:44:36 user nova-compute[72000]:       <entry name="serial">3ac42bf3-8ecd-497e-8224-cb586ad57088</entry>
Aug 16 18:44:36 user nova-compute[72000]:       <entry name="uuid">3ac42bf3-8ecd-497e-8224-cb586ad57088</entry>
Aug 16 18:44:36 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:44:36 user nova-compute[72000]:     </system>
Aug 16 18:44:36 user nova-compute[72000]:   </sysinfo>
Aug 16 18:44:36 user nova-compute[72000]:   <os>
Aug 16 18:44:36 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:44:36 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:44:36 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:44:36 user nova-compute[72000]:   </os>
Aug 16 18:44:36 user nova-compute[72000]:   <features>
Aug 16 18:44:36 user nova-compute[72000]:     <acpi/>
Aug 16 18:44:36 user nova-compute[72000]:     <apic/>
Aug 16 18:44:36 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:44:36 user nova-compute[72000]:   </features>
Aug 16 18:44:36 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:44:36 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:44:36 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:44:36 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:44:36 user nova-compute[72000]:   </clock>
Aug 16 18:44:36 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:44:36 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:44:36 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:44:36 user nova-compute[72000]:   </cpu>
Aug 16 18:44:36 user nova-compute[72000]:   <devices>
Aug 16 18:44:36 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:44:36 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:44:36 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk"/>
Aug 16 18:44:36 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:44:36 user nova-compute[72000]:     </disk>
Aug 16 18:44:36 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:44:36 user nova-compute[72000]:       <mac address="fa:16:3e:9d:31:d6"/>
Aug 16 18:44:36 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:44:36 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:44:36 user nova-compute[72000]:       <target dev="tap6e8f6cc2-37"/>
Aug 16 18:44:36 user nova-compute[72000]:     </interface>
Aug 16 18:44:36 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:44:36 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/console.log" append="off"/>
Aug 16 18:44:36 user nova-compute[72000]:     </serial>
Aug 16 18:44:36 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:44:36 user nova-compute[72000]:     <video>
Aug 16 18:44:36 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:44:36 user nova-compute[72000]:     </video>
Aug 16 18:44:36 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:44:36 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:44:36 user nova-compute[72000]:     </rng>
Aug 16 18:44:36 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:44:36 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:44:36 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:44:36 user nova-compute[72000]:     </memballoon>
Aug 16 18:44:36 user nova-compute[72000]:   </devices>
Aug 16 18:44:36 user nova-compute[72000]: </domain>
Aug 16 18:44:36 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:44:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1887245521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1887245521',id=46,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-7sczevw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:44:34Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=3ac42bf3-8ecd-497e-8224-cb586ad57088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:31:d6,bridge_name='br-int',has_traffic_filtering=True,id=6e8f6cc2-37ad-4af2-b1ca-1bf306579a09,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8f6cc2-37') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG os_vif [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:31:d6,bridge_name='br-int',has_traffic_filtering=True,id=6e8f6cc2-37ad-4af2-b1ca-1bf306579a09,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8f6cc2-37') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e8f6cc2-37, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e8f6cc2-37, col_values=(('external_ids', {'iface-id': '6e8f6cc2-37ad-4af2-b1ca-1bf306579a09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:31:d6', 'vm-uuid': '3ac42bf3-8ecd-497e-8224-cb586ad57088'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:36 user nova-compute[72000]: INFO os_vif [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:31:d6,bridge_name='br-int',has_traffic_filtering=True,id=6e8f6cc2-37ad-4af2-b1ca-1bf306579a09,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8f6cc2-37')
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No VIF found with MAC fa:16:3e:9d:31:d6, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-49a0cddd-32d4-4882-8fef-191f8c8e2227 req-3c2e370f-f6d1-4565-ac1b-321c002bb3c4 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Updated VIF entry in instance network info cache for port 6e8f6cc2-37ad-4af2-b1ca-1bf306579a09. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG nova.network.neutron [req-49a0cddd-32d4-4882-8fef-191f8c8e2227 req-3c2e370f-f6d1-4565-ac1b-321c002bb3c4 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Updating instance_info_cache with network_info: [{"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:44:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-49a0cddd-32d4-4882-8fef-191f8c8e2227 req-3c2e370f-f6d1-4565-ac1b-321c002bb3c4 service nova] Releasing lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:44:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-be3434e6-f109-4637-97fc-3a44f688f66b req-6819f268-163c-4d49-9a31-5f6a1d707306 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Received event network-vif-plugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:44:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-be3434e6-f109-4637-97fc-3a44f688f66b req-6819f268-163c-4d49-9a31-5f6a1d707306 service nova] Acquiring lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:44:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-be3434e6-f109-4637-97fc-3a44f688f66b req-6819f268-163c-4d49-9a31-5f6a1d707306 service nova] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:44:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-be3434e6-f109-4637-97fc-3a44f688f66b req-6819f268-163c-4d49-9a31-5f6a1d707306 service nova] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:44:37 user nova-compute[72000]: DEBUG nova.compute.manager [req-be3434e6-f109-4637-97fc-3a44f688f66b req-6819f268-163c-4d49-9a31-5f6a1d707306 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] No waiting events found dispatching network-vif-plugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:44:37 user nova-compute[72000]: WARNING nova.compute.manager [req-be3434e6-f109-4637-97fc-3a44f688f66b req-6819f268-163c-4d49-9a31-5f6a1d707306 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Received unexpected event network-vif-plugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 for instance with vm_state building and task_state spawning.
Aug 16 18:44:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211479.4191282, 3ac42bf3-8ecd-497e-8224-cb586ad57088 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:44:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] VM Resumed (Lifecycle Event)
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:44:39 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Instance spawned successfully.
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:44:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211479.420005, 3ac42bf3-8ecd-497e-8224-cb586ad57088 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:44:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] VM Started (Lifecycle Event)
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:44:39 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:44:39 user nova-compute[72000]: INFO nova.compute.manager [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:44:39 user nova-compute[72000]: INFO nova.compute.manager [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Took 6.09 seconds to build instance.
Aug 16 18:44:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-091e3408-b2bd-4e7d-9161-32b80cf8cc50 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.210s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-466db889-71fc-4026-b8ce-a905b72f8d2c req-87022bfc-c281-4b0d-a928-9a7322de3e47 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Received event network-vif-plugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-466db889-71fc-4026-b8ce-a905b72f8d2c req-87022bfc-c281-4b0d-a928-9a7322de3e47 service nova] Acquiring lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-466db889-71fc-4026-b8ce-a905b72f8d2c req-87022bfc-c281-4b0d-a928-9a7322de3e47 service nova] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-466db889-71fc-4026-b8ce-a905b72f8d2c req-87022bfc-c281-4b0d-a928-9a7322de3e47 service nova] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:44:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-466db889-71fc-4026-b8ce-a905b72f8d2c req-87022bfc-c281-4b0d-a928-9a7322de3e47 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] No waiting events found dispatching network-vif-plugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:44:39 user nova-compute[72000]: WARNING nova.compute.manager [req-466db889-71fc-4026-b8ce-a905b72f8d2c req-87022bfc-c281-4b0d-a928-9a7322de3e47 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Received unexpected event network-vif-plugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 for instance with vm_state active and task_state None.
Aug 16 18:44:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:44 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:44:44 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:44:45 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:44:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:44:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:44:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:44:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:44:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:44:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:44:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:44:52 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:44:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:44:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:44:52 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:44:53 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:44:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:44:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:44:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:44:53 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:44:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:44:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:44:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:54 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:44:54 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:44:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=23.47073745727539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ac42bf3-8ecd-497e-8224-cb586ad57088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:44:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:44:55 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:44:55 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:44:55 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:44:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:44:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:44:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:45:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:45:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:45:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:45:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:45:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:45:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:45:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:45:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:45:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:46 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:45:46 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:45:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:45:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:45:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:45:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:45:51 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:45:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:45:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:45:51 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:45:51 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:45:52 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updating instance_info_cache with network_info: [{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:45:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:45:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:45:53 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:45:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:45:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:45:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:45:53 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:45:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:45:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:45:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:45:54 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:45:54 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:45:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=23.468441009521484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ac42bf3-8ecd-497e-8224-cb586ad57088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:45:54 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:45:55 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:45:55 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:45:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:45:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:45:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:45:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:45:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:45:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:45:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:45:58 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:45:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:46:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:46:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:46:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:46:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:46:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:46:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:46:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:46:24 user nova-compute[72000]: INFO nova.compute.manager [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] instance snapshotting
Aug 16 18:46:24 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Beginning live snapshot process
Aug 16 18:46:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json -f qcow2 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:46:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:46:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json -f qcow2 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:46:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:46:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:46:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:46:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp61ucciyd/0abc88f3d767437abee60e33ecca85ac.delta 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:46:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp61ucciyd/0abc88f3d767437abee60e33ecca85ac.delta 1073741824" returned: 0 in 0.049s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:46:25 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 16 18:46:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:46:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:46:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72000) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 16 18:46:26 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 16 18:46:26 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:46:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp61ucciyd/0abc88f3d767437abee60e33ecca85ac.delta /opt/stack/data/nova/instances/snapshots/tmp61ucciyd/0abc88f3d767437abee60e33ecca85ac {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:46:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp61ucciyd/0abc88f3d767437abee60e33ecca85ac.delta /opt/stack/data/nova/instances/snapshots/tmp61ucciyd/0abc88f3d767437abee60e33ecca85ac" returned: 0 in 0.532s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:46:27 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Snapshot extracted, beginning image upload
Aug 16 18:46:29 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Snapshot image upload complete
Aug 16 18:46:29 user nova-compute[72000]: INFO nova.compute.manager [None req-d41c442f-7b3b-4a9a-ad2c-1c87c20cce97 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Took 4.93 seconds to snapshot the instance on the hypervisor.
Aug 16 18:46:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:46:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:46:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:46:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:46:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:46:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:46:47 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:46:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:46:49 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:46:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:46:53 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:46:53 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:46:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:46:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:46:53 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:46:54 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:46:55 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:46:55 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8701MB free_disk=23.4189453125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ac42bf3-8ecd-497e-8224-cb586ad57088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:46:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:46:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:46:58 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:46:58 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:47:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:47:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:47:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:47:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:47:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:47:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:47:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:47:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:47:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:47:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:47:30 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:47:31 user nova-compute[72000]: INFO nova.compute.claims [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Claim successful on node user
Aug 16 18:47:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:47:31 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:47:31 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:47:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:47:31 user nova-compute[72000]: INFO nova.virt.block_device [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Booting with volume-backed-image c19ae381-62a6-4e07-8c3a-fefacf5c24ea at /dev/vda
Aug 16 18:47:31 user nova-compute[72000]: DEBUG nova.policy [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26718511a87349cfa05d63a131cdeafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb2848418984c0f8c5f6418555534c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:47:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Successfully created port: 14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:47:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Successfully updated port: 14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:47:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:47:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquired lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:47:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:47:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-7d1ecd03-d91f-4e23-9f53-44a2f1334e30 req-6e8ace60-b45d-4b2d-9647-87f31c144d99 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-changed-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:47:32 user nova-compute[72000]: DEBUG nova.compute.manager [req-7d1ecd03-d91f-4e23-9f53-44a2f1334e30 req-6e8ace60-b45d-4b2d-9647-87f31c144d99 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Refreshing instance network info cache due to event network-changed-14b8f6dd-09fa-4ee7-adad-f7a36711e84d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:47:32 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7d1ecd03-d91f-4e23-9f53-44a2f1334e30 req-6e8ace60-b45d-4b2d-9647-87f31c144d99 service nova] Acquiring lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:47:32 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:47:33 user nova-compute[72000]: DEBUG nova.network.neutron [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Updating instance_info_cache with network_info: [{"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:47:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Releasing lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:47:33 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Instance network_info: |[{"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:47:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7d1ecd03-d91f-4e23-9f53-44a2f1334e30 req-6e8ace60-b45d-4b2d-9647-87f31c144d99 service nova] Acquired lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:47:33 user nova-compute[72000]: DEBUG nova.network.neutron [req-7d1ecd03-d91f-4e23-9f53-44a2f1334e30 req-6e8ace60-b45d-4b2d-9647-87f31c144d99 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Refreshing network info cache for port 14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:47:33 user nova-compute[72000]: DEBUG nova.network.neutron [req-7d1ecd03-d91f-4e23-9f53-44a2f1334e30 req-6e8ace60-b45d-4b2d-9647-87f31c144d99 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Updated VIF entry in instance network info cache for port 14b8f6dd-09fa-4ee7-adad-f7a36711e84d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:47:33 user nova-compute[72000]: DEBUG nova.network.neutron [req-7d1ecd03-d91f-4e23-9f53-44a2f1334e30 req-6e8ace60-b45d-4b2d-9647-87f31c144d99 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Updating instance_info_cache with network_info: [{"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:47:33 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7d1ecd03-d91f-4e23-9f53-44a2f1334e30 req-6e8ace60-b45d-4b2d-9647-87f31c144d99 service nova] Releasing lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:47:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:47:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:47:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:47:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:47:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG os_brick.utils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[83351dd9-06ec-4e9e-b4a7-f34408c3c383]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7efed5-eb93-4d6a-ab0d-4d23cd84f21a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[387e92ef-b07e-4455-a590-7c6b48b055c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1738017-b7c0-43eb-8a91-7bf828308c52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 18:47:42 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 18:47:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eef44a9-1b66-455f-ae1f-19a11a1415c9]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG os_brick.utils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:47:42 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Updating existing volume attachment record: e3961158-4885-4b54-a9b6-e2b03c9922b9 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 18:47:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:47:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:47:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:47:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:47:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:47:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:48 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:49 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:49 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:47:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:47:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:47:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:47:54 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Updating instance_info_cache with network_info: [{"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:55 user nova-compute[72000]: WARNING nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] While synchronizing instance power states, found 4 instances in the database and 3 instances on the hypervisor.
Aug 16 18:47:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 3ac42bf3-8ecd-497e-8224-cb586ad57088 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 00d282a0-3998-458c-bbc1-b6c1366e3e01 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "3ac42bf3-8ecd-497e-8224-cb586ad57088" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:55 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:47:56 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:47:56 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:47:56 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8710MB free_disk=23.41791534423828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ac42bf3-8ecd-497e-8224-cb586ad57088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 00d282a0-3998-458c-bbc1-b6c1366e3e01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:47:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:47:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Creating image(s)
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Did not create local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Ensure instance console log exists: /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Start _get_guest_xml network_info=[{"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYranxdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00d282a0-3998-458c-bbc1-b6c1366e3e01', 'attached_at': '', 'detached_at': '', 'volume_id': '62092575-3853-4f88-a698-8ab958870f01', 'serial': '62092575-3853-4f88-a698-8ab958870f01'}, 'attachment_id': 'e3961158-4885-4b54-a9b6-e2b03c9922b9', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:47:59 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:47:59 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYranxdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:47:59 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:47:59 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:47:59 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[de520db7-b659-41b6-bc75-10c445678622]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 18:47:59 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[794de58d-d78e-4000-8a23-1efa2d32990b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01] added
Aug 16 18:47:59 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[947fc5fb-4338-4874-a4a9-5fa6d7200c34]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d11078-477d-46f9-9b66-ccf0ba5bdede]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYranxdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYranxdc" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd7a1cc-e0b4-44f9-af7b-bc2497103b41]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GYranxdc'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[59503a31-b3ac-47bf-aa50-76387c47cd88]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8939cb-893a-4de6-933c-25e9d98fab3d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:47:59 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:47:59 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f64eea7-ea34-4294-b178-087417f64889]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01, portal: 172.16.0.220,3260]
Aug 16 18:47:59 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01, portal: 172.16.0.220,3260] successful.
Aug 16 18:47:59 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[057e91aa-0b73-48e6-b390-879f7bc240c7]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[505d73f2-19d8-4475-b30f-cc8dc4558f70]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:47:59 user nova-compute[72000]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 (non-flash)
Aug 16 18:47:59 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:47:59 user nova-compute[72000]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 (non-flash)
Aug 16 18:47:59 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd48a616-6092-4884-a51e-eeec075ba677]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:47:59 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYranxdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26430363763646539', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430363763646539', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389119460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389119460',id=47,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-1nj2qb1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:47:31Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=00d282a0-3998-458c-bbc1-b6c1366e3e01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:22:ec,bridge_name='br-int',has_traffic_filtering=True,id=14b8f6dd-09fa-4ee7-adad-f7a36711e84d,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b8f6dd-09') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'pci_devices' on Instance uuid 00d282a0-3998-458c-bbc1-b6c1366e3e01 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:48:00 user nova-compute[72000]:   <uuid>00d282a0-3998-458c-bbc1-b6c1366e3e01</uuid>
Aug 16 18:48:00 user nova-compute[72000]:   <name>instance-0000002f</name>
Aug 16 18:48:00 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:48:00 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:48:00 user nova-compute[72000]:   <metadata>
Aug 16 18:48:00 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:48:00 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:48:00 user nova-compute[72000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1389119460</nova:name>
Aug 16 18:48:00 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:47:59</nova:creationTime>
Aug 16 18:48:00 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:48:00 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:48:00 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:48:00 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:48:00 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:48:00 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:48:00 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:48:00 user nova-compute[72000]:       <nova:owner>
Aug 16 18:48:00 user nova-compute[72000]:         <nova:user uuid="26718511a87349cfa05d63a131cdeafa">tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member</nova:user>
Aug 16 18:48:00 user nova-compute[72000]:         <nova:project uuid="efb2848418984c0f8c5f6418555534c5">tempest-ServerBootFromVolumeStableRescueTest-761401575</nova:project>
Aug 16 18:48:00 user nova-compute[72000]:       </nova:owner>
Aug 16 18:48:00 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:48:00 user nova-compute[72000]:       <nova:ports>
Aug 16 18:48:00 user nova-compute[72000]:         <nova:port uuid="14b8f6dd-09fa-4ee7-adad-f7a36711e84d">
Aug 16 18:48:00 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 18:48:00 user nova-compute[72000]:         </nova:port>
Aug 16 18:48:00 user nova-compute[72000]:       </nova:ports>
Aug 16 18:48:00 user nova-compute[72000]:     </nova:instance>
Aug 16 18:48:00 user nova-compute[72000]:   </metadata>
Aug 16 18:48:00 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:48:00 user nova-compute[72000]:     <system>
Aug 16 18:48:00 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:48:00 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:48:00 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:48:00 user nova-compute[72000]:       <entry name="serial">00d282a0-3998-458c-bbc1-b6c1366e3e01</entry>
Aug 16 18:48:00 user nova-compute[72000]:       <entry name="uuid">00d282a0-3998-458c-bbc1-b6c1366e3e01</entry>
Aug 16 18:48:00 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:48:00 user nova-compute[72000]:     </system>
Aug 16 18:48:00 user nova-compute[72000]:   </sysinfo>
Aug 16 18:48:00 user nova-compute[72000]:   <os>
Aug 16 18:48:00 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:48:00 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:48:00 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:48:00 user nova-compute[72000]:   </os>
Aug 16 18:48:00 user nova-compute[72000]:   <features>
Aug 16 18:48:00 user nova-compute[72000]:     <acpi/>
Aug 16 18:48:00 user nova-compute[72000]:     <apic/>
Aug 16 18:48:00 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:48:00 user nova-compute[72000]:   </features>
Aug 16 18:48:00 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:48:00 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:48:00 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:48:00 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:48:00 user nova-compute[72000]:   </clock>
Aug 16 18:48:00 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:48:00 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:48:00 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:48:00 user nova-compute[72000]:   </cpu>
Aug 16 18:48:00 user nova-compute[72000]:   <devices>
Aug 16 18:48:00 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:48:00 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:48:00 user nova-compute[72000]:       <source dev="/dev/sdc"/>
Aug 16 18:48:00 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:48:00 user nova-compute[72000]:       <serial>62092575-3853-4f88-a698-8ab958870f01</serial>
Aug 16 18:48:00 user nova-compute[72000]:     </disk>
Aug 16 18:48:00 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:48:00 user nova-compute[72000]:       <mac address="fa:16:3e:18:22:ec"/>
Aug 16 18:48:00 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:48:00 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:48:00 user nova-compute[72000]:       <target dev="tap14b8f6dd-09"/>
Aug 16 18:48:00 user nova-compute[72000]:     </interface>
Aug 16 18:48:00 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:48:00 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/console.log" append="off"/>
Aug 16 18:48:00 user nova-compute[72000]:     </serial>
Aug 16 18:48:00 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:48:00 user nova-compute[72000]:     <video>
Aug 16 18:48:00 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:48:00 user nova-compute[72000]:     </video>
Aug 16 18:48:00 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:48:00 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:48:00 user nova-compute[72000]:     </rng>
Aug 16 18:48:00 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:48:00 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:48:00 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:48:00 user nova-compute[72000]:     </memballoon>
Aug 16 18:48:00 user nova-compute[72000]:   </devices>
Aug 16 18:48:00 user nova-compute[72000]: </domain>
Aug 16 18:48:00 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389119460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389119460',id=47,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-1nj2qb1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:47:31Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=00d282a0-3998-458c-bbc1-b6c1366e3e01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:22:ec,bridge_name='br-int',has_traffic_filtering=True,id=14b8f6dd-09fa-4ee7-adad-f7a36711e84d,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b8f6dd-09') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG os_vif [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:22:ec,bridge_name='br-int',has_traffic_filtering=True,id=14b8f6dd-09fa-4ee7-adad-f7a36711e84d,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b8f6dd-09') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14b8f6dd-09, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14b8f6dd-09, col_values=(('external_ids', {'iface-id': '14b8f6dd-09fa-4ee7-adad-f7a36711e84d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:22:ec', 'vm-uuid': '00d282a0-3998-458c-bbc1-b6c1366e3e01'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:00 user nova-compute[72000]: INFO os_vif [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:22:ec,bridge_name='br-int',has_traffic_filtering=True,id=14b8f6dd-09fa-4ee7-adad-f7a36711e84d,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b8f6dd-09')
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:48:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No VIF found with MAC fa:16:3e:18:22:ec, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-83d3266c-9644-41c0-8d05-91d2de12b8e3 req-1ac29a65-6edf-40e9-9fd8-c99875726ba3 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-83d3266c-9644-41c0-8d05-91d2de12b8e3 req-1ac29a65-6edf-40e9-9fd8-c99875726ba3 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-83d3266c-9644-41c0-8d05-91d2de12b8e3 req-1ac29a65-6edf-40e9-9fd8-c99875726ba3 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-83d3266c-9644-41c0-8d05-91d2de12b8e3 req-1ac29a65-6edf-40e9-9fd8-c99875726ba3 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:48:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-83d3266c-9644-41c0-8d05-91d2de12b8e3 req-1ac29a65-6edf-40e9-9fd8-c99875726ba3 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:48:01 user nova-compute[72000]: WARNING nova.compute.manager [req-83d3266c-9644-41c0-8d05-91d2de12b8e3 req-1ac29a65-6edf-40e9-9fd8-c99875726ba3 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state building and task_state spawning.
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211683.7990546, 00d282a0-3998-458c-bbc1-b6c1366e3e01 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:48:03 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] VM Resumed (Lifecycle Event)
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:48:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Instance spawned successfully.
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:48:03 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211683.801305, 00d282a0-3998-458c-bbc1-b6c1366e3e01 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:48:03 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] VM Started (Lifecycle Event)
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:48:03 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:48:03 user nova-compute[72000]: INFO nova.compute.manager [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Took 4.87 seconds to spawn the instance on the hypervisor.
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:48:03 user nova-compute[72000]: INFO nova.compute.manager [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Took 32.93 seconds to build instance.
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-b8864669-da9e-46e5-a4cf-5b404f4aa746 req-586e5bde-cf11-4448-9936-6ea080ca9a3a service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b8864669-da9e-46e5-a4cf-5b404f4aa746 req-586e5bde-cf11-4448-9936-6ea080ca9a3a service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b8864669-da9e-46e5-a4cf-5b404f4aa746 req-586e5bde-cf11-4448-9936-6ea080ca9a3a service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b8864669-da9e-46e5-a4cf-5b404f4aa746 req-586e5bde-cf11-4448-9936-6ea080ca9a3a service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:48:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-b8864669-da9e-46e5-a4cf-5b404f4aa746 req-586e5bde-cf11-4448-9936-6ea080ca9a3a service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:48:03 user nova-compute[72000]: WARNING nova.compute.manager [req-b8864669-da9e-46e5-a4cf-5b404f4aa746 req-586e5bde-cf11-4448-9936-6ea080ca9a3a service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state active and task_state None.
Aug 16 18:48:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5f9b6faf-9030-48de-bf76-f7b286fc570e tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.034s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:48:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.714s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:48:04 user nova-compute[72000]: INFO nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 16 18:48:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:48:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:48:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:48:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:49 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:48:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:48:50 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:48:50 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:48:50 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:48:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:48:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:48:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:48:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:48:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:48:54 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:48:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:48:55 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updating instance_info_cache with network_info: [{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:48:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:48:55 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:48:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:48:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:48:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:48:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:48:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:48:56 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:48:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:48:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:48:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:48:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:48:57 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:48:57 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:48:57 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=23.416568756103516GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ac42bf3-8ecd-497e-8224-cb586ad57088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 00d282a0-3998-458c-bbc1-b6c1366e3e01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:48:57 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:48:58 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:48:58 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:48:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:48:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:49:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:49:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:49:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:49:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:49:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:21 user nova-compute[72000]: INFO nova.compute.manager [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Rescuing
Aug 16 18:49:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:49:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquired lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:49:21 user nova-compute[72000]: DEBUG nova.network.neutron [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG nova.network.neutron [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Updating instance_info_cache with network_info: [{"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Releasing lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-572e05c4-ecc6-44b9-ab2a-65f1030b9d59 req-462da0c7-05c1-4b4a-bd33-c6ccb0b596ed service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-572e05c4-ecc6-44b9-ab2a-65f1030b9d59 req-462da0c7-05c1-4b4a-bd33-c6ccb0b596ed service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-572e05c4-ecc6-44b9-ab2a-65f1030b9d59 req-462da0c7-05c1-4b4a-bd33-c6ccb0b596ed service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-572e05c4-ecc6-44b9-ab2a-65f1030b9d59 req-462da0c7-05c1-4b4a-bd33-c6ccb0b596ed service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-572e05c4-ecc6-44b9-ab2a-65f1030b9d59 req-462da0c7-05c1-4b4a-bd33-c6ccb0b596ed service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:49:22 user nova-compute[72000]: WARNING nova.compute.manager [req-572e05c4-ecc6-44b9-ab2a-65f1030b9d59 req-462da0c7-05c1-4b4a-bd33-c6ccb0b596ed service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state active and task_state rescuing.
Aug 16 18:49:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Instance destroyed successfully.
Aug 16 18:49:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Attempting a stable device rescue
Aug 16 18:49:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72000) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 16 18:49:23 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Instance directory exists: not creating {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 16 18:49:23 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Creating image(s)
Aug 16 18:49:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "/opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "/opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "/opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:23 user nova-compute[72000]: DEBUG nova.objects.instance [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00d282a0-3998-458c-bbc1-b6c1366e3e01 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:49:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "21a1a3346c788c822e2d7451c20b5d34d856d49d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "21a1a3346c788c822e2d7451c20b5d34d856d49d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d.part --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d.part --force-share --output=json" returned: 0 in 0.191s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.virt.images [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] 9cc20d96-24de-4b46-9639-5416d5c74cac was qcow2, converting to raw {{(pid=72000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d.part /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d.converted {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d.part /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d.converted" returned: 0 in 0.389s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d.converted --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:49:24 user nova-compute[72000]: WARNING nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state active and task_state rescuing.
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:49:24 user nova-compute[72000]: WARNING nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state active and task_state rescuing.
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:49:24 user nova-compute[72000]: WARNING nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state active and task_state rescuing.
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:49:24 user nova-compute[72000]: WARNING nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state active and task_state rescuing.
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:24 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:49:24 user nova-compute[72000]: WARNING nova.compute.manager [req-9d51c93b-fe13-41a5-8d81-e20c08cf0be7 req-a68d0483-81a8-49ee-abc3-6f5d2b848dc8 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state active and task_state rescuing.
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "21a1a3346c788c822e2d7451c20b5d34d856d49d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.834s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "21a1a3346c788c822e2d7451c20b5d34d856d49d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "21a1a3346c788c822e2d7451c20b5d34d856d49d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d,backing_fmt=raw /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d,backing_fmt=raw /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue" returned: 0 in 0.049s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "21a1a3346c788c822e2d7451c20b5d34d856d49d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.objects.instance [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'migration_context' on Instance uuid 00d282a0-3998-458c-bbc1-b6c1366e3e01 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Start _get_guest_xml network_info=[{"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "vif_mac": "fa:16:3e:18:22:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9cc20d96-24de-4b46-9639-5416d5c74cac', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYranxdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '00d282a0-3998-458c-bbc1-b6c1366e3e01', 'attached_at': '', 'detached_at': '', 'volume_id': '62092575-3853-4f88-a698-8ab958870f01', 'serial': '62092575-3853-4f88-a698-8ab958870f01'}, 'attachment_id': 'e3961158-4885-4b54-a9b6-e2b03c9922b9', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.objects.instance [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'resources' on Instance uuid 00d282a0-3998-458c-bbc1-b6c1366e3e01 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.objects.instance [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'numa_topology' on Instance uuid 00d282a0-3998-458c-bbc1-b6c1366e3e01 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:49:25 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:49:25 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.objects.instance [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00d282a0-3998-458c-bbc1-b6c1366e3e01 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYranxdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:49:25 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:49:25 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:49:25 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52a1079-bc56-451c-98c4-e1f4bbb33ed1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GYranxdc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 16 18:49:25 user nova-compute[72000]: node.name = iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01
Aug 16 18:49:25 user nova-compute[72000]: node.tpgt = -1
Aug 16 18:49:25 user nova-compute[72000]: node.startup = automatic
Aug 16 18:49:25 user nova-compute[72000]: node.leading_login = No
Aug 16 18:49:25 user nova-compute[72000]: iface.iscsi_ifacename = default
Aug 16 18:49:25 user nova-compute[72000]: iface.net_ifacename = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.ipaddress = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.prefix_len = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.hwaddress = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.transport_name = tcp
Aug 16 18:49:25 user nova-compute[72000]: iface.initiatorname = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.state = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.vlan_id = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.vlan_priority = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.vlan_state = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.iface_num = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.mtu = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.port = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.bootproto = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.subnet_mask = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.gateway = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.dhcp_alt_client_id_state = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.dhcp_alt_client_id = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.dhcp_dns = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.dhcp_learn_iqn = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.dhcp_req_vendor_id_state = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.dhcp_vendor_id_state = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.dhcp_vendor_id = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.dhcp_slp_da = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.fragmentation = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.gratuitous_arp = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.incoming_forwarding = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.tos_state = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.tos = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.ttl = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.delayed_ack = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.tcp_nagle = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.tcp_wsf_state = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.tcp_wsf = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.tcp_timer_scale = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.tcp_timestamp = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.redirect = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.def_task_mgmt_timeout = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.header_digest = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.data_digest = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.immediate_data = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.initial_r2t = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.data_seq_inorder = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.data_pdu_inorder = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.erl = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.max_receive_data_len = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.first_burst_len = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.max_outstanding_r2t = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.max_burst_len = 0
Aug 16 18:49:25 user nova-compute[72000]: iface.chap_auth = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.bidi_chap = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.strict_login_compliance = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.discovery_auth = <empty>
Aug 16 18:49:25 user nova-compute[72000]: iface.discovery_logout = <empty>
Aug 16 18:49:25 user nova-compute[72000]: node.discovery_address = <empty>
Aug 16 18:49:25 user nova-compute[72000]: node.discovery_port = 0
Aug 16 18:49:25 user nova-compute[72000]: node.discovery_type = static
Aug 16 18:49:25 user nova-compute[72000]: node.session.initial_cmdsn = 0
Aug 16 18:49:25 user nova-compute[72000]: node.session.initial_login_retry_max = 8
Aug 16 18:49:25 user nova-compute[72000]: node.session.xmit_thread_priority = -20
Aug 16 18:49:25 user nova-compute[72000]: node.session.cmds_max = 128
Aug 16 18:49:25 user nova-compute[72000]: node.session.queue_depth = 32
Aug 16 18:49:25 user nova-compute[72000]: node.session.nr_sessions = 1
Aug 16 18:49:25 user nova-compute[72000]: node.session.auth.authmethod = CHAP
Aug 16 18:49:25 user nova-compute[72000]: node.session.auth.username = GYranxdc
Aug 16 18:49:25 user nova-compute[72000]: node.session.auth.password = ***
Aug 16 18:49:25 user nova-compute[72000]: node.session.auth.username_in = <empty>
Aug 16 18:49:25 user nova-compute[72000]: node.session.auth.password_in = <empty>
Aug 16 18:49:25 user nova-compute[72000]: node.session.auth.chap_algs = MD5
Aug 16 18:49:25 user nova-compute[72000]: node.session.timeo.replacement_timeout = 120
Aug 16 18:49:25 user nova-compute[72000]: node.session.err_timeo.abort_timeout = 15
Aug 16 18:49:25 user nova-compute[72000]: node.session.err_timeo.lu_reset_timeout = 30
Aug 16 18:49:25 user nova-compute[72000]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 16 18:49:25 user nova-compute[72000]: node.session.err_timeo.host_reset_timeout = 60
Aug 16 18:49:25 user nova-compute[72000]: node.session.iscsi.FastAbort = Yes
Aug 16 18:49:25 user nova-compute[72000]: node.session.iscsi.InitialR2T = No
Aug 16 18:49:25 user nova-compute[72000]: node.session.iscsi.ImmediateData = Yes
Aug 16 18:49:25 user nova-compute[72000]: node.session.iscsi.FirstBurstLength = 262144
Aug 16 18:49:25 user nova-compute[72000]: node.session.iscsi.MaxBurstLength = 16776192
Aug 16 18:49:25 user nova-compute[72000]: node.session.iscsi.DefaultTime2Retain = 0
Aug 16 18:49:25 user nova-compute[72000]: node.session.iscsi.DefaultTime2Wait = 2
Aug 16 18:49:25 user nova-compute[72000]: node.session.iscsi.MaxConnections = 1
Aug 16 18:49:25 user nova-compute[72000]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 16 18:49:25 user nova-compute[72000]: node.session.iscsi.ERL = 0
Aug 16 18:49:25 user nova-compute[72000]: node.session.scan = manual
Aug 16 18:49:25 user nova-compute[72000]: node.session.reopen_max = 0
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].address = 172.16.0.220
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].port = 3260
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].startup = manual
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].tcp.window_size = 524288
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].tcp.type_of_service = 0
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].timeo.logout_timeout = 15
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].timeo.login_timeout = 15
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].timeo.auth_timeout = 45
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].timeo.noop_out_interval = 5
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].timeo.noop_out_timeout = 5
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].iscsi.HeaderDigest = None
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].iscsi.DataDigest = None
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].iscsi.IFMarker = No
Aug 16 18:49:25 user nova-compute[72000]: node.conn[0].iscsi.OFMarker = No
Aug 16 18:49:25 user nova-compute[72000]: # END RECORD
Aug 16 18:49:25 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1072f47e-a583-4ceb-983e-7c0ee192b272]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[539cc696-63fd-4799-9071-a56791b33c7c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYranxdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYranxdc" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8a67f2-5d98-4dc3-a5df-720d073f774a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GYranxdc'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aebd5db-3ba9-4b1c-9f4c-e05dde33a0d0]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6762978b-5e76-4e0f-88b1-6bd3a7040667]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:49:25 user nova-compute[72000]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 (non-flash)
Aug 16 18:49:25 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:49:25 user nova-compute[72000]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 (non-flash)
Aug 16 18:49:25 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] HCTL ('34', '0', '0', 0) found on session 57 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bbd011-913e-437b-a408-41e5a77ff246]: (4, ('0 0 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Searching for a device in session 57 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYranxdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.191s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] <== connect_volume: return (193ms) {'type': 'block', 'scsi_wwn': '26430363763646539', 'path': '/dev/sdc'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430363763646539', 'path': '/dev/sdc'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389119460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389119460',id=47,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:48:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-1nj2qb1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:48:04Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=00d282a0-3998-458c-bbc1-b6c1366e3e01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "vif_mac": "fa:16:3e:18:22:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "vif_mac": "fa:16:3e:18:22:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:22:ec,bridge_name='br-int',has_traffic_filtering=True,id=14b8f6dd-09fa-4ee7-adad-f7a36711e84d,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b8f6dd-09') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.objects.instance [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'pci_devices' on Instance uuid 00d282a0-3998-458c-bbc1-b6c1366e3e01 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:49:25 user nova-compute[72000]:   <uuid>00d282a0-3998-458c-bbc1-b6c1366e3e01</uuid>
Aug 16 18:49:25 user nova-compute[72000]:   <name>instance-0000002f</name>
Aug 16 18:49:25 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:49:25 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:49:25 user nova-compute[72000]:   <metadata>
Aug 16 18:49:25 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:49:25 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:49:25 user nova-compute[72000]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1389119460</nova:name>
Aug 16 18:49:25 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:49:25</nova:creationTime>
Aug 16 18:49:25 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:49:25 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:49:25 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:49:25 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:49:25 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:49:25 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:49:25 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:49:25 user nova-compute[72000]:       <nova:owner>
Aug 16 18:49:25 user nova-compute[72000]:         <nova:user uuid="26718511a87349cfa05d63a131cdeafa">tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member</nova:user>
Aug 16 18:49:25 user nova-compute[72000]:         <nova:project uuid="efb2848418984c0f8c5f6418555534c5">tempest-ServerBootFromVolumeStableRescueTest-761401575</nova:project>
Aug 16 18:49:25 user nova-compute[72000]:       </nova:owner>
Aug 16 18:49:25 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:49:25 user nova-compute[72000]:       <nova:ports>
Aug 16 18:49:25 user nova-compute[72000]:         <nova:port uuid="14b8f6dd-09fa-4ee7-adad-f7a36711e84d">
Aug 16 18:49:25 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 16 18:49:25 user nova-compute[72000]:         </nova:port>
Aug 16 18:49:25 user nova-compute[72000]:       </nova:ports>
Aug 16 18:49:25 user nova-compute[72000]:     </nova:instance>
Aug 16 18:49:25 user nova-compute[72000]:   </metadata>
Aug 16 18:49:25 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:49:25 user nova-compute[72000]:     <system>
Aug 16 18:49:25 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:49:25 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:49:25 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:49:25 user nova-compute[72000]:       <entry name="serial">00d282a0-3998-458c-bbc1-b6c1366e3e01</entry>
Aug 16 18:49:25 user nova-compute[72000]:       <entry name="uuid">00d282a0-3998-458c-bbc1-b6c1366e3e01</entry>
Aug 16 18:49:25 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:49:25 user nova-compute[72000]:     </system>
Aug 16 18:49:25 user nova-compute[72000]:   </sysinfo>
Aug 16 18:49:25 user nova-compute[72000]:   <os>
Aug 16 18:49:25 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:49:25 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:49:25 user nova-compute[72000]:   </os>
Aug 16 18:49:25 user nova-compute[72000]:   <features>
Aug 16 18:49:25 user nova-compute[72000]:     <acpi/>
Aug 16 18:49:25 user nova-compute[72000]:     <apic/>
Aug 16 18:49:25 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:49:25 user nova-compute[72000]:   </features>
Aug 16 18:49:25 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:49:25 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:49:25 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:49:25 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:49:25 user nova-compute[72000]:   </clock>
Aug 16 18:49:25 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:49:25 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:49:25 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:49:25 user nova-compute[72000]:   </cpu>
Aug 16 18:49:25 user nova-compute[72000]:   <devices>
Aug 16 18:49:25 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 18:49:25 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 18:49:25 user nova-compute[72000]:       <source dev="/dev/sdc"/>
Aug 16 18:49:25 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:49:25 user nova-compute[72000]:       <serial>62092575-3853-4f88-a698-8ab958870f01</serial>
Aug 16 18:49:25 user nova-compute[72000]:     </disk>
Aug 16 18:49:25 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:49:25 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:49:25 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue"/>
Aug 16 18:49:25 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 18:49:25 user nova-compute[72000]:       <boot order="1"/>
Aug 16 18:49:25 user nova-compute[72000]:     </disk>
Aug 16 18:49:25 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:49:25 user nova-compute[72000]:       <mac address="fa:16:3e:18:22:ec"/>
Aug 16 18:49:25 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:49:25 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:49:25 user nova-compute[72000]:       <target dev="tap14b8f6dd-09"/>
Aug 16 18:49:25 user nova-compute[72000]:     </interface>
Aug 16 18:49:25 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:49:25 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/console.log" append="off"/>
Aug 16 18:49:25 user nova-compute[72000]:     </serial>
Aug 16 18:49:25 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:49:25 user nova-compute[72000]:     <video>
Aug 16 18:49:25 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:49:25 user nova-compute[72000]:     </video>
Aug 16 18:49:25 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:49:25 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:49:25 user nova-compute[72000]:     </rng>
Aug 16 18:49:25 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:49:25 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:49:25 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:49:25 user nova-compute[72000]:     </memballoon>
Aug 16 18:49:25 user nova-compute[72000]:   </devices>
Aug 16 18:49:25 user nova-compute[72000]: </domain>
Aug 16 18:49:25 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:49:25 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Instance destroyed successfully.
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:49:25 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] No VIF found with MAC fa:16:3e:18:22:ec, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:49:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:27 user nova-compute[72000]: DEBUG nova.compute.manager [req-4348104f-ce42-44b9-903c-a25223c61016 req-0919845d-aac6-47da-91f5-fc3329c1b1d0 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:49:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4348104f-ce42-44b9-903c-a25223c61016 req-0919845d-aac6-47da-91f5-fc3329c1b1d0 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4348104f-ce42-44b9-903c-a25223c61016 req-0919845d-aac6-47da-91f5-fc3329c1b1d0 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4348104f-ce42-44b9-903c-a25223c61016 req-0919845d-aac6-47da-91f5-fc3329c1b1d0 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:27 user nova-compute[72000]: DEBUG nova.compute.manager [req-4348104f-ce42-44b9-903c-a25223c61016 req-0919845d-aac6-47da-91f5-fc3329c1b1d0 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:49:27 user nova-compute[72000]: WARNING nova.compute.manager [req-4348104f-ce42-44b9-903c-a25223c61016 req-0919845d-aac6-47da-91f5-fc3329c1b1d0 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state active and task_state rescuing.
Aug 16 18:49:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:29 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for 00d282a0-3998-458c-bbc1-b6c1366e3e01 due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:49:29 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211769.031478, 00d282a0-3998-458c-bbc1-b6c1366e3e01 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:49:29 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] VM Resumed (Lifecycle Event)
Aug 16 18:49:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-694d4165-880f-4f41-aa9c-21719a56ebd9 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:49:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:49:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:49:29 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 16 18:49:29 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211769.035638, 00d282a0-3998-458c-bbc1-b6c1366e3e01 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:49:29 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] VM Started (Lifecycle Event)
Aug 16 18:49:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:49:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:49:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-4dbea033-38da-47a8-ae24-c9c8a437de26 req-5727b781-ed5a-4b10-a978-c7f7398909a3 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:49:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4dbea033-38da-47a8-ae24-c9c8a437de26 req-5727b781-ed5a-4b10-a978-c7f7398909a3 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4dbea033-38da-47a8-ae24-c9c8a437de26 req-5727b781-ed5a-4b10-a978-c7f7398909a3 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-4dbea033-38da-47a8-ae24-c9c8a437de26 req-5727b781-ed5a-4b10-a978-c7f7398909a3 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-4dbea033-38da-47a8-ae24-c9c8a437de26 req-5727b781-ed5a-4b10-a978-c7f7398909a3 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:49:29 user nova-compute[72000]: WARNING nova.compute.manager [req-4dbea033-38da-47a8-ae24-c9c8a437de26 req-5727b781-ed5a-4b10-a978-c7f7398909a3 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state rescued and task_state None.
Aug 16 18:49:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:49:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:49 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:49:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:49:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:49:52 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:49:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:49:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:49:56 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:49:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:49:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:49:56 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:49:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:49:58 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:49:58 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:49:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8530MB free_disk=23.31987762451172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ac42bf3-8ecd-497e-8224-cb586ad57088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 00d282a0-3998-458c-bbc1-b6c1366e3e01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:49:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:49:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:50:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:50:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:50:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:06 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:50:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:50:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:50:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:50:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:50 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:50:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:50:52 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:50:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:50:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:50:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:50:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:50:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:50:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:50:56 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:50:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:50:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:50:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:50:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:50:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:50:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:50:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:50:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:50:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:50:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:50:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:50:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:50:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:50:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:50:58 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:50:58 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:50:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8609MB free_disk=23.31891632080078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ac42bf3-8ecd-497e-8224-cb586ad57088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 00d282a0-3998-458c-bbc1-b6c1366e3e01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:50:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:50:59 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:50:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:50:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:50:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:50:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:50:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Updating instance_info_cache with network_info: [{"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:50:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-3ac42bf3-8ecd-497e-8224-cb586ad57088" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:50:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:51:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:51:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:51:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:51:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:51:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:12 user nova-compute[72000]: INFO nova.compute.manager [None req-48badf74-ea4e-4aa3-ba60-875d98d7b4d3 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Unrescuing
Aug 16 18:51:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48badf74-ea4e-4aa3-ba60-875d98d7b4d3 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:51:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48badf74-ea4e-4aa3-ba60-875d98d7b4d3 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquired lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:51:12 user nova-compute[72000]: DEBUG nova.network.neutron [None req-48badf74-ea4e-4aa3-ba60-875d98d7b4d3 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:51:13 user nova-compute[72000]: DEBUG nova.network.neutron [None req-48badf74-ea4e-4aa3-ba60-875d98d7b4d3 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Updating instance_info_cache with network_info: [{"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:51:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-48badf74-ea4e-4aa3-ba60-875d98d7b4d3 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Releasing lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:51:13 user nova-compute[72000]: DEBUG nova.objects.instance [None req-48badf74-ea4e-4aa3-ba60-875d98d7b4d3 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'flavor' on Instance uuid 00d282a0-3998-458c-bbc1-b6c1366e3e01 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:51:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-45027e3d-10ea-4802-9303-39ee2bb83e76 req-e3ab8be9-7a38-460a-bd84-c02f99fc5e44 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-45027e3d-10ea-4802-9303-39ee2bb83e76 req-e3ab8be9-7a38-460a-bd84-c02f99fc5e44 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-45027e3d-10ea-4802-9303-39ee2bb83e76 req-e3ab8be9-7a38-460a-bd84-c02f99fc5e44 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-45027e3d-10ea-4802-9303-39ee2bb83e76 req-e3ab8be9-7a38-460a-bd84-c02f99fc5e44 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-45027e3d-10ea-4802-9303-39ee2bb83e76 req-e3ab8be9-7a38-460a-bd84-c02f99fc5e44 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:51:14 user nova-compute[72000]: WARNING nova.compute.manager [req-45027e3d-10ea-4802-9303-39ee2bb83e76 req-e3ab8be9-7a38-460a-bd84-c02f99fc5e44 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Instance destroyed successfully.
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:51:16 user nova-compute[72000]: WARNING nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:51:16 user nova-compute[72000]: WARNING nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:51:16 user nova-compute[72000]: WARNING nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:51:16 user nova-compute[72000]: WARNING nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:51:16 user nova-compute[72000]: WARNING nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:51:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:51:16 user nova-compute[72000]: WARNING nova.compute.manager [req-e401b1cf-f444-4366-a970-cbbbf6034fba req-61ddf253-04c6-4d58-95b4-4c7f46534dc9 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state rescued and task_state unrescuing.
Aug 16 18:51:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for 00d282a0-3998-458c-bbc1-b6c1366e3e01 due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 18:51:17 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211877.888873, 00d282a0-3998-458c-bbc1-b6c1366e3e01 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:51:17 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] VM Resumed (Lifecycle Event)
Aug 16 18:51:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-48badf74-ea4e-4aa3-ba60-875d98d7b4d3 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:51:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:51:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:51:17 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 16 18:51:17 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692211877.890004, 00d282a0-3998-458c-bbc1-b6c1366e3e01 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:51:17 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] VM Started (Lifecycle Event)
Aug 16 18:51:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:51:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:51:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-1838fca6-cad2-4508-8859-59a7be5e8368 req-80b57261-d26a-4781-8dcc-21f1bfcbae59 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:51:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1838fca6-cad2-4508-8859-59a7be5e8368 req-80b57261-d26a-4781-8dcc-21f1bfcbae59 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:51:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1838fca6-cad2-4508-8859-59a7be5e8368 req-80b57261-d26a-4781-8dcc-21f1bfcbae59 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:51:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1838fca6-cad2-4508-8859-59a7be5e8368 req-80b57261-d26a-4781-8dcc-21f1bfcbae59 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:51:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-1838fca6-cad2-4508-8859-59a7be5e8368 req-80b57261-d26a-4781-8dcc-21f1bfcbae59 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:51:18 user nova-compute[72000]: WARNING nova.compute.manager [req-1838fca6-cad2-4508-8859-59a7be5e8368 req-80b57261-d26a-4781-8dcc-21f1bfcbae59 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state active and task_state None.
Aug 16 18:51:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:51:52 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:51:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:51:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:51:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:51:58 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:51:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:51:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:51:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:51:58 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Updating instance_info_cache with network_info: [{"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-00d282a0-3998-458c-bbc1-b6c1366e3e01" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:51:59 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:52:00 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:52:00 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:52:00 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8549MB free_disk=23.318988800048828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ac42bf3-8ecd-497e-8224-cb586ad57088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 00d282a0-3998-458c-bbc1-b6c1366e3e01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:52:00 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:52:01 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:52:01 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:52:01 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:52:01 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:52:01 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:52:01 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:52:01 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:52:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:52:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:52:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:52:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:52:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:52:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:52:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:52:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:52:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:52:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:52:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:52:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:52:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:52:45 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:52:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:52:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:52 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:52:57 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:58 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:52:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:52:58 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:52:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:52:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:52:58 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:52:58 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:52:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updating instance_info_cache with network_info: [{"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:52:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-6c9ae44a-2f84-46cd-8515-c993397e5d7e" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:52:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:53:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:53:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:00 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:53:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:00 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:53:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:00 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:01 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:53:01 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:53:01 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8633MB free_disk=23.318405151367188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 3ac42bf3-8ecd-497e-8224-cb586ad57088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 00d282a0-3998-458c-bbc1-b6c1366e3e01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:53:01 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:53:02 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:53:02 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:53:02 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:53:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:04 user nova-compute[72000]: INFO nova.compute.manager [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Terminating instance
Aug 16 18:53:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-5e2c2905-3799-449e-b761-80e7b71bc393 req-24c55306-f95f-4154-826e-a8728e93ce3e service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5e2c2905-3799-449e-b761-80e7b71bc393 req-24c55306-f95f-4154-826e-a8728e93ce3e service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5e2c2905-3799-449e-b761-80e7b71bc393 req-24c55306-f95f-4154-826e-a8728e93ce3e service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5e2c2905-3799-449e-b761-80e7b71bc393 req-24c55306-f95f-4154-826e-a8728e93ce3e service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-5e2c2905-3799-449e-b761-80e7b71bc393 req-24c55306-f95f-4154-826e-a8728e93ce3e service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG nova.compute.manager [req-5e2c2905-3799-449e-b761-80e7b71bc393 req-24c55306-f95f-4154-826e-a8728e93ce3e service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-unplugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:04 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Instance destroyed successfully.
Aug 16 18:53:04 user nova-compute[72000]: DEBUG nova.objects.instance [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'resources' on Instance uuid 00d282a0-3998-458c-bbc1-b6c1366e3e01 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:47:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1389119460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1389119460',id=47,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:49:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-1nj2qb1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:51:18Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=00d282a0-3998-458c-bbc1-b6c1366e3e01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "address": "fa:16:3e:18:22:ec", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14b8f6dd-09", "ovs_interfaceid": "14b8f6dd-09fa-4ee7-adad-f7a36711e84d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:22:ec,bridge_name='br-int',has_traffic_filtering=True,id=14b8f6dd-09fa-4ee7-adad-f7a36711e84d,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b8f6dd-09') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG os_vif [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:22:ec,bridge_name='br-int',has_traffic_filtering=True,id=14b8f6dd-09fa-4ee7-adad-f7a36711e84d,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b8f6dd-09') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14b8f6dd-09, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:53:04 user nova-compute[72000]: INFO os_vif [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:22:ec,bridge_name='br-int',has_traffic_filtering=True,id=14b8f6dd-09fa-4ee7-adad-f7a36711e84d,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14b8f6dd-09')
Aug 16 18:53:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYranxdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:53:04 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:53:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11a3fc4-1889-41a9-8e31-69b81c2db051]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:53:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[192f74d5-ae3f-42c7-a593-c3b3a7413c3c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:53:05 user nova-compute[72000]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 (non-flash)
Aug 16 18:53:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:53:05 user nova-compute[72000]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 (non-flash)
Aug 16 18:53:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0087a8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01'): ({'sdc'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Removing single pathed devices sdc {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[015214ac-0976-4775-8327-d465514dbb20]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[466dc5b0-bbc4-4eda-9cc2-d77873c410ad]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flushing IO for device /dev/sdc {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a51d41-7121-4515-9895-11fd28deedd1]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74b19e5-d209-4c63-8bb2-4ebb999f3cfc]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] SCSI volumes sdc have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7269467-c51f-46bc-9f92-7e5fa818952c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29d4f69-ad95-4fd4-b3e2-8f2d55e4e3d9]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01, portal: 172.16.0.220,3260]
Aug 16 18:53:05 user nova-compute[72000]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01, portal: 172.16.0.220,3260] successful.
Aug 16 18:53:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62092575-3853-4f88-a698-8ab958870f01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9e908-a881-48a3-9204-a2bfe142267b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] <== disconnect_volume: return (276ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:53:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Deleting instance files /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01_del
Aug 16 18:53:05 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Deletion of /opt/stack/data/nova/instances/00d282a0-3998-458c-bbc1-b6c1366e3e01_del complete
Aug 16 18:53:05 user nova-compute[72000]: INFO nova.compute.manager [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:53:05 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:53:05 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Took 0.45 seconds to deallocate network for instance.
Aug 16 18:53:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-b801d7b4-0a16-47c6-9ea1-13f0fe9e01aa req-28c97e33-d66f-44d2-bce8-a418389cc359 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-deleted-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:53:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-6f2e7fb7-410d-443b-a54a-308d21e627c1 req-f3e55c2f-1c6d-4ff2-8bbd-fd2b6afb60c0 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:53:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6f2e7fb7-410d-443b-a54a-308d21e627c1 req-f3e55c2f-1c6d-4ff2-8bbd-fd2b6afb60c0 service nova] Acquiring lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6f2e7fb7-410d-443b-a54a-308d21e627c1 req-f3e55c2f-1c6d-4ff2-8bbd-fd2b6afb60c0 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6f2e7fb7-410d-443b-a54a-308d21e627c1 req-f3e55c2f-1c6d-4ff2-8bbd-fd2b6afb60c0 service nova] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:06 user nova-compute[72000]: DEBUG nova.compute.manager [req-6f2e7fb7-410d-443b-a54a-308d21e627c1 req-f3e55c2f-1c6d-4ff2-8bbd-fd2b6afb60c0 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] No waiting events found dispatching network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:53:06 user nova-compute[72000]: WARNING nova.compute.manager [req-6f2e7fb7-410d-443b-a54a-308d21e627c1 req-f3e55c2f-1c6d-4ff2-8bbd-fd2b6afb60c0 service nova] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Received unexpected event network-vif-plugged-14b8f6dd-09fa-4ee7-adad-f7a36711e84d for instance with vm_state active and task_state deleting.
Aug 16 18:53:06 user nova-compute[72000]: INFO nova.compute.manager [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Took 0.81 seconds to detach 1 volumes for instance.
Aug 16 18:53:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:06 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:53:06 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:53:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:06 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Deleted allocations for instance 00d282a0-3998-458c-bbc1-b6c1366e3e01
Aug 16 18:53:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-d6d137ad-aa0e-439c-9039-f9f46a5774b2 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "00d282a0-3998-458c-bbc1-b6c1366e3e01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.753s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:53:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:19 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692211984.9124603, 00d282a0-3998-458c-bbc1-b6c1366e3e01 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:53:19 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] VM Stopped (Lifecycle Event)
Aug 16 18:53:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5436c965-ffc4-45f6-a169-db618e93223c None None] [instance: 00d282a0-3998-458c-bbc1-b6c1366e3e01] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:53:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:53:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:53:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:53:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:53:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:53:53 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:53:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:53:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "3ac42bf3-8ecd-497e-8224-cb586ad57088" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:54 user nova-compute[72000]: INFO nova.compute.manager [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Terminating instance
Aug 16 18:53:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:53:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-787fd75e-eebf-41f9-9236-5b457bcd69f1 req-016d4279-b6c8-4f87-bef9-2d2f9c686b79 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Received event network-vif-unplugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-787fd75e-eebf-41f9-9236-5b457bcd69f1 req-016d4279-b6c8-4f87-bef9-2d2f9c686b79 service nova] Acquiring lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-787fd75e-eebf-41f9-9236-5b457bcd69f1 req-016d4279-b6c8-4f87-bef9-2d2f9c686b79 service nova] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-787fd75e-eebf-41f9-9236-5b457bcd69f1 req-016d4279-b6c8-4f87-bef9-2d2f9c686b79 service nova] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-787fd75e-eebf-41f9-9236-5b457bcd69f1 req-016d4279-b6c8-4f87-bef9-2d2f9c686b79 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] No waiting events found dispatching network-vif-unplugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-787fd75e-eebf-41f9-9236-5b457bcd69f1 req-016d4279-b6c8-4f87-bef9-2d2f9c686b79 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Received event network-vif-unplugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:55 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Instance destroyed successfully.
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.objects.instance [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'resources' on Instance uuid 3ac42bf3-8ecd-497e-8224-cb586ad57088 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:44:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1887245521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1887245521',id=46,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:44:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-7sczevw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:46:29Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=3ac42bf3-8ecd-497e-8224-cb586ad57088,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "address": "fa:16:3e:9d:31:d6", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e8f6cc2-37", "ovs_interfaceid": "6e8f6cc2-37ad-4af2-b1ca-1bf306579a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:31:d6,bridge_name='br-int',has_traffic_filtering=True,id=6e8f6cc2-37ad-4af2-b1ca-1bf306579a09,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8f6cc2-37') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG os_vif [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:31:d6,bridge_name='br-int',has_traffic_filtering=True,id=6e8f6cc2-37ad-4af2-b1ca-1bf306579a09,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8f6cc2-37') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e8f6cc2-37, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:53:55 user nova-compute[72000]: INFO os_vif [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:31:d6,bridge_name='br-int',has_traffic_filtering=True,id=6e8f6cc2-37ad-4af2-b1ca-1bf306579a09,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e8f6cc2-37')
Aug 16 18:53:55 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Deleting instance files /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088_del
Aug 16 18:53:55 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Deletion of /opt/stack/data/nova/instances/3ac42bf3-8ecd-497e-8224-cb586ad57088_del complete
Aug 16 18:53:55 user nova-compute[72000]: INFO nova.compute.manager [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Took 0.64 seconds to destroy the instance on the hypervisor.
Aug 16 18:53:55 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-434815a2-6fb2-4692-95b3-de84f3f2e6f9 req-9ad56d07-a35d-491a-a2e4-5e2b6d2efc17 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Received event network-vif-deleted-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:53:55 user nova-compute[72000]: INFO nova.compute.manager [req-434815a2-6fb2-4692-95b3-de84f3f2e6f9 req-9ad56d07-a35d-491a-a2e4-5e2b6d2efc17 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Neutron deleted interface 6e8f6cc2-37ad-4af2-b1ca-1bf306579a09; detaching it from the instance and deleting it from the info cache
Aug 16 18:53:55 user nova-compute[72000]: DEBUG nova.network.neutron [req-434815a2-6fb2-4692-95b3-de84f3f2e6f9 req-9ad56d07-a35d-491a-a2e4-5e2b6d2efc17 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:53:56 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:53:56 user nova-compute[72000]: DEBUG nova.compute.manager [req-434815a2-6fb2-4692-95b3-de84f3f2e6f9 req-9ad56d07-a35d-491a-a2e4-5e2b6d2efc17 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Detach interface failed, port_id=6e8f6cc2-37ad-4af2-b1ca-1bf306579a09, reason: Instance 3ac42bf3-8ecd-497e-8224-cb586ad57088 could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:53:56 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Took 0.55 seconds to deallocate network for instance.
Aug 16 18:53:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:56 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:53:56 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:53:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:56 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Deleted allocations for instance 3ac42bf3-8ecd-497e-8224-cb586ad57088
Aug 16 18:53:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-421b228b-19b6-4af8-a632-ac073d28fdc4 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.510s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:57 user nova-compute[72000]: DEBUG nova.compute.manager [req-22d90617-5759-4860-b9cf-b8f3dcbb1904 req-e736049a-56bf-40d2-8fe2-5f5efb6e89f4 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Received event network-vif-plugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:53:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22d90617-5759-4860-b9cf-b8f3dcbb1904 req-e736049a-56bf-40d2-8fe2-5f5efb6e89f4 service nova] Acquiring lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:53:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22d90617-5759-4860-b9cf-b8f3dcbb1904 req-e736049a-56bf-40d2-8fe2-5f5efb6e89f4 service nova] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:53:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-22d90617-5759-4860-b9cf-b8f3dcbb1904 req-e736049a-56bf-40d2-8fe2-5f5efb6e89f4 service nova] Lock "3ac42bf3-8ecd-497e-8224-cb586ad57088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:53:57 user nova-compute[72000]: DEBUG nova.compute.manager [req-22d90617-5759-4860-b9cf-b8f3dcbb1904 req-e736049a-56bf-40d2-8fe2-5f5efb6e89f4 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] No waiting events found dispatching network-vif-plugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:53:57 user nova-compute[72000]: WARNING nova.compute.manager [req-22d90617-5759-4860-b9cf-b8f3dcbb1904 req-e736049a-56bf-40d2-8fe2-5f5efb6e89f4 service nova] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Received unexpected event network-vif-plugged-6e8f6cc2-37ad-4af2-b1ca-1bf306579a09 for instance with vm_state deleted and task_state None.
Aug 16 18:53:59 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:53:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:53:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:53:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:53:59 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:54:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [{"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:54:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:54:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:54:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:54:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:54:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:54:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:54:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:54:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:54:02 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:54:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 18:54:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:54:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:54:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=23.442760467529297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:54:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:54:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:54:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:54:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:54:10 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692212035.4426668, 3ac42bf3-8ecd-497e-8224-cb586ad57088 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:54:10 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] VM Stopped (Lifecycle Event)
Aug 16 18:54:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c8c3c3b3-c0a3-4e76-8bdf-134f3bef140b None None] [instance: 3ac42bf3-8ecd-497e-8224-cb586ad57088] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:54:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:54:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:54:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:54:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:54:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:54:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:54:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:54:45 user nova-compute[72000]: INFO nova.compute.manager [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Terminating instance
Aug 16 18:54:45 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-f1c93410-3298-4fce-97ea-c75406b4f6cf req-2b6c47a4-41ac-4285-84a7-248c8a4726df service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-unplugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f1c93410-3298-4fce-97ea-c75406b4f6cf req-2b6c47a4-41ac-4285-84a7-248c8a4726df service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f1c93410-3298-4fce-97ea-c75406b4f6cf req-2b6c47a4-41ac-4285-84a7-248c8a4726df service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f1c93410-3298-4fce-97ea-c75406b4f6cf req-2b6c47a4-41ac-4285-84a7-248c8a4726df service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-f1c93410-3298-4fce-97ea-c75406b4f6cf req-2b6c47a4-41ac-4285-84a7-248c8a4726df service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-unplugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG nova.compute.manager [req-f1c93410-3298-4fce-97ea-c75406b4f6cf req-2b6c47a4-41ac-4285-84a7-248c8a4726df service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-unplugged-067f46f9-2823-4340-8889-317e063f7514 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:46 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Instance destroyed successfully.
Aug 16 18:54:46 user nova-compute[72000]: DEBUG nova.objects.instance [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'resources' on Instance uuid c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:38:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-624288220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-624288220',id=45,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:40:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-zhi3p01c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:42:46Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "067f46f9-2823-4340-8889-317e063f7514", "address": "fa:16:3e:a2:fe:2d", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap067f46f9-28", "ovs_interfaceid": "067f46f9-2823-4340-8889-317e063f7514", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:fe:2d,bridge_name='br-int',has_traffic_filtering=True,id=067f46f9-2823-4340-8889-317e063f7514,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067f46f9-28') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_vif [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:fe:2d,bridge_name='br-int',has_traffic_filtering=True,id=067f46f9-2823-4340-8889-317e063f7514,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067f46f9-28') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap067f46f9-28, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:46 user nova-compute[72000]: INFO os_vif [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:fe:2d,bridge_name='br-int',has_traffic_filtering=True,id=067f46f9-2823-4340-8889-317e063f7514,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap067f46f9-28')
Aug 16 18:54:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkHMKDjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 18:54:46 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2dd93-909d-4aab-af87-b53609753eb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae499b5-2e48-4063-b147-e408977148a2]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:54:46 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 (non-flash)
Aug 16 18:54:46 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcfe877f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dba843-ab62-49eb-b348-a3d595c45e24]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4b7170-51a1-47d4-8dab-267459f15237]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ecd373-8e82-4283-a31c-088a808d150f]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f974d3a-deda-4390-9754-bc4235399e7b]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d328fa-87dc-4fbf-b066-d6c5fe2582d4]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f440404b-f8a0-4946-9ecd-5ef18426ec0f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1, portal: 172.16.0.220,3260]
Aug 16 18:54:46 user nova-compute[72000]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1, portal: 172.16.0.220,3260] successful.
Aug 16 18:54:46 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:999a768d-e0e6-47d7-af96-8d9bfa931cb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fad8262-f97a-4655-ab4d-7949d6ceb896]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] <== disconnect_volume: return (280ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 18:54:46 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Deleting instance files /opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d_del
Aug 16 18:54:46 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Deletion of /opt/stack/data/nova/instances/c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d_del complete
Aug 16 18:54:46 user nova-compute[72000]: INFO nova.compute.manager [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:46 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:54:47 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Took 0.46 seconds to deallocate network for instance.
Aug 16 18:54:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-4d39ef10-d59e-4ea8-b651-9380437712a7 req-69f60aa9-c82c-46d1-b20a-1d194f331fb6 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-deleted-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:54:47 user nova-compute[72000]: INFO nova.compute.manager [req-4d39ef10-d59e-4ea8-b651-9380437712a7 req-69f60aa9-c82c-46d1-b20a-1d194f331fb6 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Neutron deleted interface 067f46f9-2823-4340-8889-317e063f7514; detaching it from the instance and deleting it from the info cache
Aug 16 18:54:47 user nova-compute[72000]: DEBUG nova.network.neutron [req-4d39ef10-d59e-4ea8-b651-9380437712a7 req-69f60aa9-c82c-46d1-b20a-1d194f331fb6 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:54:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-4d39ef10-d59e-4ea8-b651-9380437712a7 req-69f60aa9-c82c-46d1-b20a-1d194f331fb6 service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Detach interface failed, port_id=067f46f9-2823-4340-8889-317e063f7514, reason: Instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d could not be found. {{(pid=72000) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 16 18:54:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d73062f-07ad-4374-bb3a-508e240934ed req-4549c706-5085-4eec-83ce-f7942cabf21a service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:54:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d73062f-07ad-4374-bb3a-508e240934ed req-4549c706-5085-4eec-83ce-f7942cabf21a service nova] Acquiring lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:54:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d73062f-07ad-4374-bb3a-508e240934ed req-4549c706-5085-4eec-83ce-f7942cabf21a service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:54:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9d73062f-07ad-4374-bb3a-508e240934ed req-4549c706-5085-4eec-83ce-f7942cabf21a service nova] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:54:47 user nova-compute[72000]: DEBUG nova.compute.manager [req-9d73062f-07ad-4374-bb3a-508e240934ed req-4549c706-5085-4eec-83ce-f7942cabf21a service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] No waiting events found dispatching network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:54:47 user nova-compute[72000]: WARNING nova.compute.manager [req-9d73062f-07ad-4374-bb3a-508e240934ed req-4549c706-5085-4eec-83ce-f7942cabf21a service nova] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Received unexpected event network-vif-plugged-067f46f9-2823-4340-8889-317e063f7514 for instance with vm_state active and task_state deleting.
Aug 16 18:54:47 user nova-compute[72000]: INFO nova.compute.manager [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Took 0.83 seconds to detach 1 volumes for instance.
Aug 16 18:54:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:54:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:54:48 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:54:48 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:54:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:54:48 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Deleted allocations for instance c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d
Aug 16 18:54:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-b67bd7c7-ad06-44df-a043-6956f1ce1b7b tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.764s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:54:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:54:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:54:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:54:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:54:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:55:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:55:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 18:55:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:55:01 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692212086.1366959, c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:55:01 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] VM Stopped (Lifecycle Event)
Aug 16 18:55:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-8b7d97d5-91e5-42ce-8aa7-a2b4837869d6 None None] [instance: c52206ef-a8e8-4ef7-ac05-8c53e2fd3f6d] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:55:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:55:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:55:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:55:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:55:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:55:02 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:55:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:55:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:55:02 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:55:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:55:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:55:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:55:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=23.44196319580078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:55:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:55:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:55:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:55:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:55:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:55:03 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:55:03 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:55:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:55:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:55:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:55:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:55:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:55:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:55:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:55:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:55:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:55:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:55:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:55:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:36 user nova-compute[72000]: INFO nova.compute.manager [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Terminating instance
Aug 16 18:55:36 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-6b47c5d2-eb24-4ef0-8d05-a5cbdffbfa6a req-4f5e8d58-751e-40b9-9f56-0b93a9f83a2f service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Received event network-vif-unplugged-2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6b47c5d2-eb24-4ef0-8d05-a5cbdffbfa6a req-4f5e8d58-751e-40b9-9f56-0b93a9f83a2f service nova] Acquiring lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6b47c5d2-eb24-4ef0-8d05-a5cbdffbfa6a req-4f5e8d58-751e-40b9-9f56-0b93a9f83a2f service nova] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6b47c5d2-eb24-4ef0-8d05-a5cbdffbfa6a req-4f5e8d58-751e-40b9-9f56-0b93a9f83a2f service nova] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-6b47c5d2-eb24-4ef0-8d05-a5cbdffbfa6a req-4f5e8d58-751e-40b9-9f56-0b93a9f83a2f service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] No waiting events found dispatching network-vif-unplugged-2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG nova.compute.manager [req-6b47c5d2-eb24-4ef0-8d05-a5cbdffbfa6a req-4f5e8d58-751e-40b9-9f56-0b93a9f83a2f service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Received event network-vif-unplugged-2e9d7678-b733-426d-bcdf-68a40b8a981b for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:55:36 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Instance destroyed successfully.
Aug 16 18:55:36 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lazy-loading 'resources' on Instance uuid 6c9ae44a-2f84-46cd-8515-c993397e5d7e {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-659539355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-659539355',id=44,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:36:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efb2848418984c0f8c5f6418555534c5',ramdisk_id='',reservation_id='r-55duepyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-761401575',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:37:58Z,user_data=None,user_id='26718511a87349cfa05d63a131cdeafa',uuid=6c9ae44a-2f84-46cd-8515-c993397e5d7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:55:36 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converting VIF {"id": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "address": "fa:16:3e:e8:94:9b", "network": {"id": "fbb05470-5449-4a2d-b7e2-077b17391e8c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1310098319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efb2848418984c0f8c5f6418555534c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e9d7678-b7", "ovs_interfaceid": "2e9d7678-b733-426d-bcdf-68a40b8a981b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e9d7678-b733-426d-bcdf-68a40b8a981b,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e9d7678-b7') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG os_vif [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e9d7678-b733-426d-bcdf-68a40b8a981b,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e9d7678-b7') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e9d7678-b7, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:37 user nova-compute[72000]: INFO os_vif [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:94:9b,bridge_name='br-int',has_traffic_filtering=True,id=2e9d7678-b733-426d-bcdf-68a40b8a981b,network=Network(fbb05470-5449-4a2d-b7e2-077b17391e8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e9d7678-b7')
Aug 16 18:55:37 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Deleting instance files /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e_del
Aug 16 18:55:37 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Deletion of /opt/stack/data/nova/instances/6c9ae44a-2f84-46cd-8515-c993397e5d7e_del complete
Aug 16 18:55:37 user nova-compute[72000]: INFO nova.compute.manager [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 18:55:37 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:55:37 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Took 0.52 seconds to deallocate network for instance.
Aug 16 18:55:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:55:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:55:37 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Deleted allocations for instance 6c9ae44a-2f84-46cd-8515-c993397e5d7e
Aug 16 18:55:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4c95ae83-a7c8-405b-959f-4f638b29f845 tempest-ServerBootFromVolumeStableRescueTest-761401575 tempest-ServerBootFromVolumeStableRescueTest-761401575-project-member] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.871s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:55:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-b7ed4c64-3027-4344-881a-7ca8f89fc670 req-24ee205e-726b-44d4-9aa8-9b76da0d5483 service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Received event network-vif-plugged-2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:55:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b7ed4c64-3027-4344-881a-7ca8f89fc670 req-24ee205e-726b-44d4-9aa8-9b76da0d5483 service nova] Acquiring lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:55:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b7ed4c64-3027-4344-881a-7ca8f89fc670 req-24ee205e-726b-44d4-9aa8-9b76da0d5483 service nova] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:55:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-b7ed4c64-3027-4344-881a-7ca8f89fc670 req-24ee205e-726b-44d4-9aa8-9b76da0d5483 service nova] Lock "6c9ae44a-2f84-46cd-8515-c993397e5d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:55:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-b7ed4c64-3027-4344-881a-7ca8f89fc670 req-24ee205e-726b-44d4-9aa8-9b76da0d5483 service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] No waiting events found dispatching network-vif-plugged-2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:55:38 user nova-compute[72000]: WARNING nova.compute.manager [req-b7ed4c64-3027-4344-881a-7ca8f89fc670 req-24ee205e-726b-44d4-9aa8-9b76da0d5483 service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Received unexpected event network-vif-plugged-2e9d7678-b733-426d-bcdf-68a40b8a981b for instance with vm_state deleted and task_state None.
Aug 16 18:55:38 user nova-compute[72000]: DEBUG nova.compute.manager [req-b7ed4c64-3027-4344-881a-7ca8f89fc670 req-24ee205e-726b-44d4-9aa8-9b76da0d5483 service nova] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Received event network-vif-deleted-2e9d7678-b733-426d-bcdf-68a40b8a981b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:55:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:51 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692212136.9770334, 6c9ae44a-2f84-46cd-8515-c993397e5d7e => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:55:51 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] VM Stopped (Lifecycle Event)
Aug 16 18:55:52 user nova-compute[72000]: DEBUG nova.compute.manager [None req-edbcdda5-2f0f-4d0d-843a-3007cf12a240 None None] [instance: 6c9ae44a-2f84-46cd-8515-c993397e5d7e] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:55:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:55:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:55:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:55:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:55:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:55:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:55:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:55:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:55:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:55:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:55:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:55:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:56:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:56:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 18:56:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:56:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:56:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:56:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:56:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:56:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:56:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=23.566593170166016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:56:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:56:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:56:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:56:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:56:04 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:56:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:56:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:56:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:56:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:56:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:56:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:56:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:56:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:56:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:56:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:56:39 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:51 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:56:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:56:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:56:57 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:57:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:57:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 18:57:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:57:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:57:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:57:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:57:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:57:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:57:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:57:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:57:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:57:03 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:57:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=23.556793212890625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:57:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:57:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:57:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:57:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:57:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:57:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 18:57:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:57:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "87f8701a-7a94-4a76-b600-2e608abb1d63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 18:57:25 user nova-compute[72000]: INFO nova.compute.claims [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Claim successful on node user
Aug 16 18:57:25 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.186s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 18:57:25 user nova-compute[72000]: DEBUG nova.network.neutron [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 18:57:25 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 18:57:25 user nova-compute[72000]: DEBUG nova.compute.manager [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 18:57:26 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Creating image(s)
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "/opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "/opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "/opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG nova.policy [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58d9819a9d9847768368bd4a155c438e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5730ad92f56c490c8677c842d8dd5824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk 1073741824" returned: 0 in 0.052s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG nova.network.neutron [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Successfully created port: d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Cannot resize image /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG nova.objects.instance [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lazy-loading 'migration_context' on Instance uuid 87f8701a-7a94-4a76-b600-2e608abb1d63 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Ensure instance console log exists: /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:57:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Successfully updated port: d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquired lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.compute.manager [req-f41ddd9f-919a-413b-a15b-ca565d3a1226 req-5c72e29a-0deb-4947-b8ec-7075cf615097 service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Received event network-changed-d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.compute.manager [req-f41ddd9f-919a-413b-a15b-ca565d3a1226 req-5c72e29a-0deb-4947-b8ec-7075cf615097 service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Refreshing instance network info cache due to event network-changed-d0cdc33c-a379-4fd1-8e5a-93708beee2ef. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f41ddd9f-919a-413b-a15b-ca565d3a1226 req-5c72e29a-0deb-4947-b8ec-7075cf615097 service nova] Acquiring lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.network.neutron [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Updating instance_info_cache with network_info: [{"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Releasing lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.compute.manager [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Instance network_info: |[{"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f41ddd9f-919a-413b-a15b-ca565d3a1226 req-5c72e29a-0deb-4947-b8ec-7075cf615097 service nova] Acquired lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.network.neutron [req-f41ddd9f-919a-413b-a15b-ca565d3a1226 req-5c72e29a-0deb-4947-b8ec-7075cf615097 service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Refreshing network info cache for port d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Start _get_guest_xml network_info=[{"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 18:57:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:57:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-796243605',display_name='tempest-VolumesActionsTest-instance-796243605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-796243605',id=48,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5730ad92f56c490c8677c842d8dd5824',ramdisk_id='',reservation_id='r-08zyk6h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-647308985',owner_user_name='tempest-VolumesActionsTest-647308985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:57:26Z,user_data=None,user_id='58d9819a9d9847768368bd4a155c438e',uuid=87f8701a-7a94-4a76-b600-2e608abb1d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converting VIF {"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=d0cdc33c-a379-4fd1-8e5a-93708beee2ef,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cdc33c-a3') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.objects.instance [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lazy-loading 'pci_devices' on Instance uuid 87f8701a-7a94-4a76-b600-2e608abb1d63 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] End _get_guest_xml xml=<domain type="kvm">
Aug 16 18:57:27 user nova-compute[72000]:   <uuid>87f8701a-7a94-4a76-b600-2e608abb1d63</uuid>
Aug 16 18:57:27 user nova-compute[72000]:   <name>instance-00000030</name>
Aug 16 18:57:27 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 18:57:27 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 18:57:27 user nova-compute[72000]:   <metadata>
Aug 16 18:57:27 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 18:57:27 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 18:57:27 user nova-compute[72000]:       <nova:name>tempest-VolumesActionsTest-instance-796243605</nova:name>
Aug 16 18:57:27 user nova-compute[72000]:       <nova:creationTime>2023-08-16 18:57:27</nova:creationTime>
Aug 16 18:57:27 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 18:57:27 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 18:57:27 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 18:57:27 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 18:57:27 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 18:57:27 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 18:57:27 user nova-compute[72000]:       </nova:flavor>
Aug 16 18:57:27 user nova-compute[72000]:       <nova:owner>
Aug 16 18:57:27 user nova-compute[72000]:         <nova:user uuid="58d9819a9d9847768368bd4a155c438e">tempest-VolumesActionsTest-647308985-project-member</nova:user>
Aug 16 18:57:27 user nova-compute[72000]:         <nova:project uuid="5730ad92f56c490c8677c842d8dd5824">tempest-VolumesActionsTest-647308985</nova:project>
Aug 16 18:57:27 user nova-compute[72000]:       </nova:owner>
Aug 16 18:57:27 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 18:57:27 user nova-compute[72000]:       <nova:ports>
Aug 16 18:57:27 user nova-compute[72000]:         <nova:port uuid="d0cdc33c-a379-4fd1-8e5a-93708beee2ef">
Aug 16 18:57:27 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 16 18:57:27 user nova-compute[72000]:         </nova:port>
Aug 16 18:57:27 user nova-compute[72000]:       </nova:ports>
Aug 16 18:57:27 user nova-compute[72000]:     </nova:instance>
Aug 16 18:57:27 user nova-compute[72000]:   </metadata>
Aug 16 18:57:27 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 18:57:27 user nova-compute[72000]:     <system>
Aug 16 18:57:27 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 18:57:27 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 18:57:27 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 18:57:27 user nova-compute[72000]:       <entry name="serial">87f8701a-7a94-4a76-b600-2e608abb1d63</entry>
Aug 16 18:57:27 user nova-compute[72000]:       <entry name="uuid">87f8701a-7a94-4a76-b600-2e608abb1d63</entry>
Aug 16 18:57:27 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 18:57:27 user nova-compute[72000]:     </system>
Aug 16 18:57:27 user nova-compute[72000]:   </sysinfo>
Aug 16 18:57:27 user nova-compute[72000]:   <os>
Aug 16 18:57:27 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 18:57:27 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 18:57:27 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 18:57:27 user nova-compute[72000]:   </os>
Aug 16 18:57:27 user nova-compute[72000]:   <features>
Aug 16 18:57:27 user nova-compute[72000]:     <acpi/>
Aug 16 18:57:27 user nova-compute[72000]:     <apic/>
Aug 16 18:57:27 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 18:57:27 user nova-compute[72000]:   </features>
Aug 16 18:57:27 user nova-compute[72000]:   <clock offset="utc">
Aug 16 18:57:27 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 18:57:27 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 18:57:27 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 18:57:27 user nova-compute[72000]:   </clock>
Aug 16 18:57:27 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 18:57:27 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 18:57:27 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 18:57:27 user nova-compute[72000]:   </cpu>
Aug 16 18:57:27 user nova-compute[72000]:   <devices>
Aug 16 18:57:27 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 18:57:27 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 18:57:27 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk"/>
Aug 16 18:57:27 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 18:57:27 user nova-compute[72000]:     </disk>
Aug 16 18:57:27 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 18:57:27 user nova-compute[72000]:       <mac address="fa:16:3e:30:81:4b"/>
Aug 16 18:57:27 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:57:27 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 18:57:27 user nova-compute[72000]:       <target dev="tapd0cdc33c-a3"/>
Aug 16 18:57:27 user nova-compute[72000]:     </interface>
Aug 16 18:57:27 user nova-compute[72000]:     <serial type="pty">
Aug 16 18:57:27 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/console.log" append="off"/>
Aug 16 18:57:27 user nova-compute[72000]:     </serial>
Aug 16 18:57:27 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 18:57:27 user nova-compute[72000]:     <video>
Aug 16 18:57:27 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 18:57:27 user nova-compute[72000]:     </video>
Aug 16 18:57:27 user nova-compute[72000]:     <rng model="virtio">
Aug 16 18:57:27 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 18:57:27 user nova-compute[72000]:     </rng>
Aug 16 18:57:27 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 18:57:27 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 18:57:27 user nova-compute[72000]:       <stats period="10"/>
Aug 16 18:57:27 user nova-compute[72000]:     </memballoon>
Aug 16 18:57:27 user nova-compute[72000]:   </devices>
Aug 16 18:57:27 user nova-compute[72000]: </domain>
Aug 16 18:57:27 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-796243605',display_name='tempest-VolumesActionsTest-instance-796243605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-796243605',id=48,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5730ad92f56c490c8677c842d8dd5824',ramdisk_id='',reservation_id='r-08zyk6h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-647308985',owner_user_name='tempest-VolumesActionsTest-647308985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T18:57:26Z,user_data=None,user_id='58d9819a9d9847768368bd4a155c438e',uuid=87f8701a-7a94-4a76-b600-2e608abb1d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converting VIF {"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=d0cdc33c-a379-4fd1-8e5a-93708beee2ef,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cdc33c-a3') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG os_vif [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=d0cdc33c-a379-4fd1-8e5a-93708beee2ef,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cdc33c-a3') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0cdc33c-a3, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0cdc33c-a3, col_values=(('external_ids', {'iface-id': 'd0cdc33c-a379-4fd1-8e5a-93708beee2ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:81:4b', 'vm-uuid': '87f8701a-7a94-4a76-b600-2e608abb1d63'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:27 user nova-compute[72000]: INFO os_vif [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=d0cdc33c-a379-4fd1-8e5a-93708beee2ef,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cdc33c-a3')
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 18:57:27 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] No VIF found with MAC fa:16:3e:30:81:4b, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 18:57:28 user nova-compute[72000]: DEBUG nova.network.neutron [req-f41ddd9f-919a-413b-a15b-ca565d3a1226 req-5c72e29a-0deb-4947-b8ec-7075cf615097 service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Updated VIF entry in instance network info cache for port d0cdc33c-a379-4fd1-8e5a-93708beee2ef. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 18:57:28 user nova-compute[72000]: DEBUG nova.network.neutron [req-f41ddd9f-919a-413b-a15b-ca565d3a1226 req-5c72e29a-0deb-4947-b8ec-7075cf615097 service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Updating instance_info_cache with network_info: [{"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:57:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f41ddd9f-919a-413b-a15b-ca565d3a1226 req-5c72e29a-0deb-4947-b8ec-7075cf615097 service nova] Releasing lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-02d0fe93-0f9d-4307-85e9-c3521a20634a req-3d0f153a-1002-474b-a098-d85e1942e8ef service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Received event network-vif-plugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02d0fe93-0f9d-4307-85e9-c3521a20634a req-3d0f153a-1002-474b-a098-d85e1942e8ef service nova] Acquiring lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02d0fe93-0f9d-4307-85e9-c3521a20634a req-3d0f153a-1002-474b-a098-d85e1942e8ef service nova] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-02d0fe93-0f9d-4307-85e9-c3521a20634a req-3d0f153a-1002-474b-a098-d85e1942e8ef service nova] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG nova.compute.manager [req-02d0fe93-0f9d-4307-85e9-c3521a20634a req-3d0f153a-1002-474b-a098-d85e1942e8ef service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] No waiting events found dispatching network-vif-plugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:57:29 user nova-compute[72000]: WARNING nova.compute.manager [req-02d0fe93-0f9d-4307-85e9-c3521a20634a req-3d0f153a-1002-474b-a098-d85e1942e8ef service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Received unexpected event network-vif-plugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef for instance with vm_state building and task_state spawning.
Aug 16 18:57:29 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692212251.2006607, 87f8701a-7a94-4a76-b600-2e608abb1d63 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:57:31 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] VM Resumed (Lifecycle Event)
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 18:57:31 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Instance spawned successfully.
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 18:57:31 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692212251.202074, 87f8701a-7a94-4a76-b600-2e608abb1d63 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:57:31 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] VM Started (Lifecycle Event)
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 18:57:31 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 18:57:31 user nova-compute[72000]: INFO nova.compute.manager [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:57:31 user nova-compute[72000]: INFO nova.compute.manager [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Took 5.83 seconds to build instance.
Aug 16 18:57:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-16ccecf0-b665-4f36-8d85-7d5c822934e4 tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.920s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-6e99ac95-0855-4239-bbe3-b3ca6f79edf4 req-e4470021-4dc3-4555-a163-a928e4da3a4e service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Received event network-vif-plugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e99ac95-0855-4239-bbe3-b3ca6f79edf4 req-e4470021-4dc3-4555-a163-a928e4da3a4e service nova] Acquiring lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e99ac95-0855-4239-bbe3-b3ca6f79edf4 req-e4470021-4dc3-4555-a163-a928e4da3a4e service nova] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e99ac95-0855-4239-bbe3-b3ca6f79edf4 req-e4470021-4dc3-4555-a163-a928e4da3a4e service nova] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:57:31 user nova-compute[72000]: DEBUG nova.compute.manager [req-6e99ac95-0855-4239-bbe3-b3ca6f79edf4 req-e4470021-4dc3-4555-a163-a928e4da3a4e service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] No waiting events found dispatching network-vif-plugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:57:31 user nova-compute[72000]: WARNING nova.compute.manager [req-6e99ac95-0855-4239-bbe3-b3ca6f79edf4 req-e4470021-4dc3-4555-a163-a928e4da3a4e service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Received unexpected event network-vif-plugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef for instance with vm_state active and task_state None.
Aug 16 18:57:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:57:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:57:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:57:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:57:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:57:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:55 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:57 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:57:58 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:57:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:58:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:58:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:58:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:58:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:58:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:58:00 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 87f8701a-7a94-4a76-b600-2e608abb1d63 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:58:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Updating instance_info_cache with network_info: [{"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:58:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:58:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:58:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:58:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:58:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:58:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:58:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:58:03 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:58:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:58:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:58:03 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:58:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:58:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:58:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=23.52655792236328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 87f8701a-7a94-4a76-b600-2e608abb1d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:58:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:58:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:58:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:58:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:58:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:58:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 87f8701a-7a94-4a76-b600-2e608abb1d63 {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 18:58:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "87f8701a-7a94-4a76-b600-2e608abb1d63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:58:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:58:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:58:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:58:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:17 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:58:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:22 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:58:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:58:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:32 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:58:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:37 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:58:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:58:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:58:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:58:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:58:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:58:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:58:57 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:58:57 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:59:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:59:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 18:59:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 18:59:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 18:59:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 18:59:01 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 18:59:01 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 87f8701a-7a94-4a76-b600-2e608abb1d63 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:59:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Updating instance_info_cache with network_info: [{"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:59:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-87f8701a-7a94-4a76-b600-2e608abb1d63" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 18:59:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 18:59:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:59:02 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:59:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:59:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:59:04 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:59:04 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 18:59:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:59:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:59:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 18:59:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 18:59:05 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:59:05 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 18:59:05 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=23.525924682617188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 18:59:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:59:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:59:05 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 87f8701a-7a94-4a76-b600-2e608abb1d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 18:59:05 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 18:59:05 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 18:59:05 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:59:05 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:59:05 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 18:59:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:59:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:59:07 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:59:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 18:59:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "87f8701a-7a94-4a76-b600-2e608abb1d63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:59:16 user nova-compute[72000]: INFO nova.compute.manager [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Terminating instance
Aug 16 18:59:16 user nova-compute[72000]: DEBUG nova.compute.manager [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-0f339ce1-089f-4c9a-b5d8-c5b8227ea657 req-06049d0b-51cb-42a2-a428-bb3251cb8c7f service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Received event network-vif-unplugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0f339ce1-089f-4c9a-b5d8-c5b8227ea657 req-06049d0b-51cb-42a2-a428-bb3251cb8c7f service nova] Acquiring lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0f339ce1-089f-4c9a-b5d8-c5b8227ea657 req-06049d0b-51cb-42a2-a428-bb3251cb8c7f service nova] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0f339ce1-089f-4c9a-b5d8-c5b8227ea657 req-06049d0b-51cb-42a2-a428-bb3251cb8c7f service nova] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-0f339ce1-089f-4c9a-b5d8-c5b8227ea657 req-06049d0b-51cb-42a2-a428-bb3251cb8c7f service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] No waiting events found dispatching network-vif-unplugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG nova.compute.manager [req-0f339ce1-089f-4c9a-b5d8-c5b8227ea657 req-06049d0b-51cb-42a2-a428-bb3251cb8c7f service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Received event network-vif-unplugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:16 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Instance destroyed successfully.
Aug 16 18:59:16 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lazy-loading 'resources' on Instance uuid 87f8701a-7a94-4a76-b600-2e608abb1d63 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T18:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-796243605',display_name='tempest-VolumesActionsTest-instance-796243605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-796243605',id=48,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T18:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5730ad92f56c490c8677c842d8dd5824',ramdisk_id='',reservation_id='r-08zyk6h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-647308985',owner_user_name='tempest-VolumesActionsTest-647308985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T18:57:31Z,user_data=None,user_id='58d9819a9d9847768368bd4a155c438e',uuid=87f8701a-7a94-4a76-b600-2e608abb1d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converting VIF {"id": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "address": "fa:16:3e:30:81:4b", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cdc33c-a3", "ovs_interfaceid": "d0cdc33c-a379-4fd1-8e5a-93708beee2ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=d0cdc33c-a379-4fd1-8e5a-93708beee2ef,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cdc33c-a3') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG os_vif [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=d0cdc33c-a379-4fd1-8e5a-93708beee2ef,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cdc33c-a3') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0cdc33c-a3, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:16 user nova-compute[72000]: INFO os_vif [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=d0cdc33c-a379-4fd1-8e5a-93708beee2ef,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cdc33c-a3')
Aug 16 18:59:16 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Deleting instance files /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63_del
Aug 16 18:59:16 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Deletion of /opt/stack/data/nova/instances/87f8701a-7a94-4a76-b600-2e608abb1d63_del complete
Aug 16 18:59:17 user nova-compute[72000]: INFO nova.compute.manager [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 16 18:59:17 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 18:59:17 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 18:59:17 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 18:59:17 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 18:59:17 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Took 0.52 seconds to deallocate network for instance.
Aug 16 18:59:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:59:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:59:17 user nova-compute[72000]: DEBUG nova.compute.manager [req-47ac3719-5eda-42d0-8202-f0876bd70cc7 req-7cd94a58-9750-4e50-bf74-705f90fe3e94 service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Received event network-vif-deleted-d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:59:17 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 18:59:17 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 18:59:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:59:17 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Deleted allocations for instance 87f8701a-7a94-4a76-b600-2e608abb1d63
Aug 16 18:59:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f13a8461-66f7-4f68-aeb3-27e23ea28e9c tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.691s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:59:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-ceb97838-5b4c-482a-a2ab-6370ea54f4b7 req-5ec283b2-4f09-43e1-9572-0b0021ab4be3 service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Received event network-vif-plugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 18:59:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ceb97838-5b4c-482a-a2ab-6370ea54f4b7 req-5ec283b2-4f09-43e1-9572-0b0021ab4be3 service nova] Acquiring lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 18:59:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ceb97838-5b4c-482a-a2ab-6370ea54f4b7 req-5ec283b2-4f09-43e1-9572-0b0021ab4be3 service nova] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 18:59:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ceb97838-5b4c-482a-a2ab-6370ea54f4b7 req-5ec283b2-4f09-43e1-9572-0b0021ab4be3 service nova] Lock "87f8701a-7a94-4a76-b600-2e608abb1d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 18:59:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-ceb97838-5b4c-482a-a2ab-6370ea54f4b7 req-5ec283b2-4f09-43e1-9572-0b0021ab4be3 service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] No waiting events found dispatching network-vif-plugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 18:59:18 user nova-compute[72000]: WARNING nova.compute.manager [req-ceb97838-5b4c-482a-a2ab-6370ea54f4b7 req-5ec283b2-4f09-43e1-9572-0b0021ab4be3 service nova] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Received unexpected event network-vif-plugged-d0cdc33c-a379-4fd1-8e5a-93708beee2ef for instance with vm_state deleted and task_state None.
Aug 16 18:59:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:59:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:59:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:59:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:31 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692212356.885668, 87f8701a-7a94-4a76-b600-2e608abb1d63 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 18:59:31 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] VM Stopped (Lifecycle Event)
Aug 16 18:59:31 user nova-compute[72000]: DEBUG nova.compute.manager [None req-9b3bf9d5-723a-471e-bf1f-fd123fd1aed5 None None] [instance: 87f8701a-7a94-4a76-b600-2e608abb1d63] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 18:59:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:59:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:59:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:59:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:59:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:59:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:59:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 18:59:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 18:59:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:59:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 18:59:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 18:59:57 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 18:59:58 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:00:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:00:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:00:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:00:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:00:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:00:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:00:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:00:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:00:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:00:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:00:05 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:00:06 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:00:06 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:00:06 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=23.553096771240234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:00:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:00:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:00:06 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:00:06 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:00:06 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:00:06 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:00:06 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:00:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:00:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:00:08 user nova-compute[72000]: INFO nova.compute.claims [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Claim successful on node user
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.network.neutron [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:00:08 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.policy [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58d9819a9d9847768368bd4a155c438e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5730ad92f56c490c8677c842d8dd5824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:00:08 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Creating image(s)
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "/opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "/opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "/opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.189s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:00:08 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk 1073741824" returned: 0 in 0.048s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG nova.network.neutron [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Successfully created port: 8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Cannot resize image /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG nova.objects.instance [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lazy-loading 'migration_context' on Instance uuid 68c9cb38-52d6-40b7-910d-45f7af4c96e2 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Ensure instance console log exists: /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:00:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.network.neutron [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Successfully updated port: 8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "refresh_cache-68c9cb38-52d6-40b7-910d-45f7af4c96e2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquired lock "refresh_cache-68c9cb38-52d6-40b7-910d-45f7af4c96e2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.network.neutron [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-8f880543-6330-42cf-8643-22210e955a04 req-396dacc9-8229-428a-badf-abd2c07b3308 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Received event network-changed-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-8f880543-6330-42cf-8643-22210e955a04 req-396dacc9-8229-428a-badf-abd2c07b3308 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Refreshing instance network info cache due to event network-changed-8f8c987e-7739-4455-bdfa-3e27a1b26cf9. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f880543-6330-42cf-8643-22210e955a04 req-396dacc9-8229-428a-badf-abd2c07b3308 service nova] Acquiring lock "refresh_cache-68c9cb38-52d6-40b7-910d-45f7af4c96e2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.network.neutron [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.network.neutron [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Updating instance_info_cache with network_info: [{"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Releasing lock "refresh_cache-68c9cb38-52d6-40b7-910d-45f7af4c96e2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Instance network_info: |[{"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f880543-6330-42cf-8643-22210e955a04 req-396dacc9-8229-428a-badf-abd2c07b3308 service nova] Acquired lock "refresh_cache-68c9cb38-52d6-40b7-910d-45f7af4c96e2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.network.neutron [req-8f880543-6330-42cf-8643-22210e955a04 req-396dacc9-8229-428a-badf-abd2c07b3308 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Refreshing network info cache for port 8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Start _get_guest_xml network_info=[{"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:00:10 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:00:10 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-956290723',display_name='tempest-VolumesActionsTest-instance-956290723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-956290723',id=49,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5730ad92f56c490c8677c842d8dd5824',ramdisk_id='',reservation_id='r-527kub0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-647308985',owner_user_name='tempest-VolumesActionsTest-647308985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:00:09Z,user_data=None,user_id='58d9819a9d9847768368bd4a155c438e',uuid=68c9cb38-52d6-40b7-910d-45f7af4c96e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converting VIF {"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:03,bridge_name='br-int',has_traffic_filtering=True,id=8f8c987e-7739-4455-bdfa-3e27a1b26cf9,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8c987e-77') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.objects.instance [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lazy-loading 'pci_devices' on Instance uuid 68c9cb38-52d6-40b7-910d-45f7af4c96e2 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:00:10 user nova-compute[72000]:   <uuid>68c9cb38-52d6-40b7-910d-45f7af4c96e2</uuid>
Aug 16 19:00:10 user nova-compute[72000]:   <name>instance-00000031</name>
Aug 16 19:00:10 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 19:00:10 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 19:00:10 user nova-compute[72000]:   <metadata>
Aug 16 19:00:10 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:00:10 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 19:00:10 user nova-compute[72000]:       <nova:name>tempest-VolumesActionsTest-instance-956290723</nova:name>
Aug 16 19:00:10 user nova-compute[72000]:       <nova:creationTime>2023-08-16 19:00:10</nova:creationTime>
Aug 16 19:00:10 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 19:00:10 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 19:00:10 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 19:00:10 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 19:00:10 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:00:10 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:00:10 user nova-compute[72000]:       </nova:flavor>
Aug 16 19:00:10 user nova-compute[72000]:       <nova:owner>
Aug 16 19:00:10 user nova-compute[72000]:         <nova:user uuid="58d9819a9d9847768368bd4a155c438e">tempest-VolumesActionsTest-647308985-project-member</nova:user>
Aug 16 19:00:10 user nova-compute[72000]:         <nova:project uuid="5730ad92f56c490c8677c842d8dd5824">tempest-VolumesActionsTest-647308985</nova:project>
Aug 16 19:00:10 user nova-compute[72000]:       </nova:owner>
Aug 16 19:00:10 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 19:00:10 user nova-compute[72000]:       <nova:ports>
Aug 16 19:00:10 user nova-compute[72000]:         <nova:port uuid="8f8c987e-7739-4455-bdfa-3e27a1b26cf9">
Aug 16 19:00:10 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 16 19:00:10 user nova-compute[72000]:         </nova:port>
Aug 16 19:00:10 user nova-compute[72000]:       </nova:ports>
Aug 16 19:00:10 user nova-compute[72000]:     </nova:instance>
Aug 16 19:00:10 user nova-compute[72000]:   </metadata>
Aug 16 19:00:10 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 19:00:10 user nova-compute[72000]:     <system>
Aug 16 19:00:10 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:00:10 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:00:10 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 19:00:10 user nova-compute[72000]:       <entry name="serial">68c9cb38-52d6-40b7-910d-45f7af4c96e2</entry>
Aug 16 19:00:10 user nova-compute[72000]:       <entry name="uuid">68c9cb38-52d6-40b7-910d-45f7af4c96e2</entry>
Aug 16 19:00:10 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:00:10 user nova-compute[72000]:     </system>
Aug 16 19:00:10 user nova-compute[72000]:   </sysinfo>
Aug 16 19:00:10 user nova-compute[72000]:   <os>
Aug 16 19:00:10 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:00:10 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 19:00:10 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 19:00:10 user nova-compute[72000]:   </os>
Aug 16 19:00:10 user nova-compute[72000]:   <features>
Aug 16 19:00:10 user nova-compute[72000]:     <acpi/>
Aug 16 19:00:10 user nova-compute[72000]:     <apic/>
Aug 16 19:00:10 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 19:00:10 user nova-compute[72000]:   </features>
Aug 16 19:00:10 user nova-compute[72000]:   <clock offset="utc">
Aug 16 19:00:10 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:00:10 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:00:10 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 19:00:10 user nova-compute[72000]:   </clock>
Aug 16 19:00:10 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 19:00:10 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 19:00:10 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:00:10 user nova-compute[72000]:   </cpu>
Aug 16 19:00:10 user nova-compute[72000]:   <devices>
Aug 16 19:00:10 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 19:00:10 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:00:10 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk"/>
Aug 16 19:00:10 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 19:00:10 user nova-compute[72000]:     </disk>
Aug 16 19:00:10 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 19:00:10 user nova-compute[72000]:       <mac address="fa:16:3e:e5:51:03"/>
Aug 16 19:00:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 19:00:10 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 19:00:10 user nova-compute[72000]:       <target dev="tap8f8c987e-77"/>
Aug 16 19:00:10 user nova-compute[72000]:     </interface>
Aug 16 19:00:10 user nova-compute[72000]:     <serial type="pty">
Aug 16 19:00:10 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/console.log" append="off"/>
Aug 16 19:00:10 user nova-compute[72000]:     </serial>
Aug 16 19:00:10 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:00:10 user nova-compute[72000]:     <video>
Aug 16 19:00:10 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 19:00:10 user nova-compute[72000]:     </video>
Aug 16 19:00:10 user nova-compute[72000]:     <rng model="virtio">
Aug 16 19:00:10 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:00:10 user nova-compute[72000]:     </rng>
Aug 16 19:00:10 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:00:10 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 19:00:10 user nova-compute[72000]:       <stats period="10"/>
Aug 16 19:00:10 user nova-compute[72000]:     </memballoon>
Aug 16 19:00:10 user nova-compute[72000]:   </devices>
Aug 16 19:00:10 user nova-compute[72000]: </domain>
Aug 16 19:00:10 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-956290723',display_name='tempest-VolumesActionsTest-instance-956290723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-956290723',id=49,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5730ad92f56c490c8677c842d8dd5824',ramdisk_id='',reservation_id='r-527kub0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-647308985',owner_user_name='tempest-VolumesActionsTest-647308985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:00:09Z,user_data=None,user_id='58d9819a9d9847768368bd4a155c438e',uuid=68c9cb38-52d6-40b7-910d-45f7af4c96e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converting VIF {"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:03,bridge_name='br-int',has_traffic_filtering=True,id=8f8c987e-7739-4455-bdfa-3e27a1b26cf9,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8c987e-77') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG os_vif [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:03,bridge_name='br-int',has_traffic_filtering=True,id=8f8c987e-7739-4455-bdfa-3e27a1b26cf9,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8c987e-77') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f8c987e-77, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f8c987e-77, col_values=(('external_ids', {'iface-id': '8f8c987e-7739-4455-bdfa-3e27a1b26cf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:51:03', 'vm-uuid': '68c9cb38-52d6-40b7-910d-45f7af4c96e2'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:10 user nova-compute[72000]: INFO os_vif [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:51:03,bridge_name='br-int',has_traffic_filtering=True,id=8f8c987e-7739-4455-bdfa-3e27a1b26cf9,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8c987e-77')
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:00:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] No VIF found with MAC fa:16:3e:e5:51:03, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:00:11 user nova-compute[72000]: DEBUG nova.network.neutron [req-8f880543-6330-42cf-8643-22210e955a04 req-396dacc9-8229-428a-badf-abd2c07b3308 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Updated VIF entry in instance network info cache for port 8f8c987e-7739-4455-bdfa-3e27a1b26cf9. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:00:11 user nova-compute[72000]: DEBUG nova.network.neutron [req-8f880543-6330-42cf-8643-22210e955a04 req-396dacc9-8229-428a-badf-abd2c07b3308 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Updating instance_info_cache with network_info: [{"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:00:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f880543-6330-42cf-8643-22210e955a04 req-396dacc9-8229-428a-badf-abd2c07b3308 service nova] Releasing lock "refresh_cache-68c9cb38-52d6-40b7-910d-45f7af4c96e2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:00:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-74575ff5-28af-486c-aa98-5c262033047a req-d2099af9-a6bb-4c1d-88c2-8c56d31323ee service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Received event network-vif-plugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:00:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-74575ff5-28af-486c-aa98-5c262033047a req-d2099af9-a6bb-4c1d-88c2-8c56d31323ee service nova] Acquiring lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:00:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-74575ff5-28af-486c-aa98-5c262033047a req-d2099af9-a6bb-4c1d-88c2-8c56d31323ee service nova] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:00:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-74575ff5-28af-486c-aa98-5c262033047a req-d2099af9-a6bb-4c1d-88c2-8c56d31323ee service nova] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:00:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-74575ff5-28af-486c-aa98-5c262033047a req-d2099af9-a6bb-4c1d-88c2-8c56d31323ee service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] No waiting events found dispatching network-vif-plugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:00:12 user nova-compute[72000]: WARNING nova.compute.manager [req-74575ff5-28af-486c-aa98-5c262033047a req-d2099af9-a6bb-4c1d-88c2-8c56d31323ee service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Received unexpected event network-vif-plugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 for instance with vm_state building and task_state spawning.
Aug 16 19:00:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:00:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:00:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692212414.0039806, 68c9cb38-52d6-40b7-910d-45f7af4c96e2 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:00:14 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] VM Resumed (Lifecycle Event)
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:00:14 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Instance spawned successfully.
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:00:14 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692212414.0058832, 68c9cb38-52d6-40b7-910d-45f7af4c96e2 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:00:14 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] VM Started (Lifecycle Event)
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:00:14 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:00:14 user nova-compute[72000]: INFO nova.compute.manager [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Took 5.36 seconds to spawn the instance on the hypervisor.
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-5ddc43c9-7638-4bbb-9517-8c4dc4fe4baa req-c137c079-eab0-49c9-832d-62dba268740a service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Received event network-vif-plugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5ddc43c9-7638-4bbb-9517-8c4dc4fe4baa req-c137c079-eab0-49c9-832d-62dba268740a service nova] Acquiring lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5ddc43c9-7638-4bbb-9517-8c4dc4fe4baa req-c137c079-eab0-49c9-832d-62dba268740a service nova] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5ddc43c9-7638-4bbb-9517-8c4dc4fe4baa req-c137c079-eab0-49c9-832d-62dba268740a service nova] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG nova.compute.manager [req-5ddc43c9-7638-4bbb-9517-8c4dc4fe4baa req-c137c079-eab0-49c9-832d-62dba268740a service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] No waiting events found dispatching network-vif-plugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:00:14 user nova-compute[72000]: WARNING nova.compute.manager [req-5ddc43c9-7638-4bbb-9517-8c4dc4fe4baa req-c137c079-eab0-49c9-832d-62dba268740a service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Received unexpected event network-vif-plugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 for instance with vm_state building and task_state spawning.
Aug 16 19:00:14 user nova-compute[72000]: INFO nova.compute.manager [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Took 5.87 seconds to build instance.
Aug 16 19:00:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-43be9673-f5e7-4e67-a4df-f93e1670e5cb tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.960s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:00:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:00:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:00:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:00:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:00:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:00:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:54 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:00:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:00:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:00:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:00:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:00:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:00:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:00:59 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:01:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:01:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:01:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-68c9cb38-52d6-40b7-910d-45f7af4c96e2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:01:02 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-68c9cb38-52d6-40b7-910d-45f7af4c96e2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:01:02 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:01:02 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 68c9cb38-52d6-40b7-910d-45f7af4c96e2 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:01:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Updating instance_info_cache with network_info: [{"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:01:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-68c9cb38-52d6-40b7-910d-45f7af4c96e2" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:01:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:01:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:01:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:01:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:01:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:06 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:01:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:01:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:01:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:01:06 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:01:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:01:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:01:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:01:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:01:07 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:01:07 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:01:07 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=23.523548126220703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:01:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:01:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:01:07 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 68c9cb38-52d6-40b7-910d-45f7af4c96e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:01:07 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:01:07 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:01:07 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:01:07 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:01:07 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:01:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:01:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:01:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:01:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:01:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:01:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:01:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:01:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:01:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:01:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:01:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:01:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:01:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:01:59 user nova-compute[72000]: INFO nova.compute.manager [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Terminating instance
Aug 16 19:01:59 user nova-compute[72000]: DEBUG nova.compute.manager [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG nova.compute.manager [req-6e0549cf-97c5-44f0-8cb7-672a6765d4f3 req-7c7d2bef-ef73-4aef-8f5f-426be2d67d79 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Received event network-vif-unplugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e0549cf-97c5-44f0-8cb7-672a6765d4f3 req-7c7d2bef-ef73-4aef-8f5f-426be2d67d79 service nova] Acquiring lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e0549cf-97c5-44f0-8cb7-672a6765d4f3 req-7c7d2bef-ef73-4aef-8f5f-426be2d67d79 service nova] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6e0549cf-97c5-44f0-8cb7-672a6765d4f3 req-7c7d2bef-ef73-4aef-8f5f-426be2d67d79 service nova] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG nova.compute.manager [req-6e0549cf-97c5-44f0-8cb7-672a6765d4f3 req-7c7d2bef-ef73-4aef-8f5f-426be2d67d79 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] No waiting events found dispatching network-vif-unplugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG nova.compute.manager [req-6e0549cf-97c5-44f0-8cb7-672a6765d4f3 req-7c7d2bef-ef73-4aef-8f5f-426be2d67d79 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Received event network-vif-unplugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Instance destroyed successfully.
Aug 16 19:01:59 user nova-compute[72000]: DEBUG nova.objects.instance [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lazy-loading 'resources' on Instance uuid 68c9cb38-52d6-40b7-910d-45f7af4c96e2 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-956290723',display_name='tempest-VolumesActionsTest-instance-956290723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-956290723',id=49,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:00:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5730ad92f56c490c8677c842d8dd5824',ramdisk_id='',reservation_id='r-527kub0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-647308985',owner_user_name='tempest-VolumesActionsTest-647308985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:00:14Z,user_data=None,user_id='58d9819a9d9847768368bd4a155c438e',uuid=68c9cb38-52d6-40b7-910d-45f7af4c96e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converting VIF {"id": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "address": "fa:16:3e:e5:51:03", "network": {"id": "07eefb7a-409d-4c55-a545-3ef83b84a432", "bridge": "br-int", "label": "tempest-VolumesActionsTest-994707128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5730ad92f56c490c8677c842d8dd5824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f8c987e-77", "ovs_interfaceid": "8f8c987e-7739-4455-bdfa-3e27a1b26cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:51:03,bridge_name='br-int',has_traffic_filtering=True,id=8f8c987e-7739-4455-bdfa-3e27a1b26cf9,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8c987e-77') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG os_vif [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:51:03,bridge_name='br-int',has_traffic_filtering=True,id=8f8c987e-7739-4455-bdfa-3e27a1b26cf9,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8c987e-77') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f8c987e-77, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:01:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:01:59 user nova-compute[72000]: INFO os_vif [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:51:03,bridge_name='br-int',has_traffic_filtering=True,id=8f8c987e-7739-4455-bdfa-3e27a1b26cf9,network=Network(07eefb7a-409d-4c55-a545-3ef83b84a432),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f8c987e-77')
Aug 16 19:01:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Deleting instance files /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2_del
Aug 16 19:01:59 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Deletion of /opt/stack/data/nova/instances/68c9cb38-52d6-40b7-910d-45f7af4c96e2_del complete
Aug 16 19:02:00 user nova-compute[72000]: INFO nova.compute.manager [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 16 19:02:00 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 19:02:00 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 19:02:00 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 19:02:00 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:02:00 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Took 0.46 seconds to deallocate network for instance.
Aug 16 19:02:00 user nova-compute[72000]: DEBUG nova.compute.manager [req-824c4653-1b6d-44a6-9f01-89e59a6c063e req-65b5d019-94cb-4256-b219-9912d22f88c5 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Received event network-vif-deleted-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:02:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:02:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:02:00 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:00 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:02:00 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:02:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:02:00 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Deleted allocations for instance 68c9cb38-52d6-40b7-910d-45f7af4c96e2
Aug 16 19:02:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-52224677-d746-4847-9005-73f905f881ad tempest-VolumesActionsTest-647308985 tempest-VolumesActionsTest-647308985-project-member] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.663s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:02:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-eb60acb4-87c4-4872-8091-f8edf6aae0fb req-73eae1ce-1b32-40e2-873b-98acb30b59c9 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Received event network-vif-plugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:02:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-eb60acb4-87c4-4872-8091-f8edf6aae0fb req-73eae1ce-1b32-40e2-873b-98acb30b59c9 service nova] Acquiring lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:02:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-eb60acb4-87c4-4872-8091-f8edf6aae0fb req-73eae1ce-1b32-40e2-873b-98acb30b59c9 service nova] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:02:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-eb60acb4-87c4-4872-8091-f8edf6aae0fb req-73eae1ce-1b32-40e2-873b-98acb30b59c9 service nova] Lock "68c9cb38-52d6-40b7-910d-45f7af4c96e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:02:01 user nova-compute[72000]: DEBUG nova.compute.manager [req-eb60acb4-87c4-4872-8091-f8edf6aae0fb req-73eae1ce-1b32-40e2-873b-98acb30b59c9 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] No waiting events found dispatching network-vif-plugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:02:01 user nova-compute[72000]: WARNING nova.compute.manager [req-eb60acb4-87c4-4872-8091-f8edf6aae0fb req-73eae1ce-1b32-40e2-873b-98acb30b59c9 service nova] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Received unexpected event network-vif-plugged-8f8c987e-7739-4455-bdfa-3e27a1b26cf9 for instance with vm_state deleted and task_state None.
Aug 16 19:02:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:02:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:02:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:02:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:02:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:02:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:02:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:02:08 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:02:09 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:02:09 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=23.55074691772461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:02:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:02:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:02:14 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692212519.872878, 68c9cb38-52d6-40b7-910d-45f7af4c96e2 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:02:14 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] VM Stopped (Lifecycle Event)
Aug 16 19:02:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6de8c108-a3dd-431b-ae08-4142e381572e None None] [instance: 68c9cb38-52d6-40b7-910d-45f7af4c96e2] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:02:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:02:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:02:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:02:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:02:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:02:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:02:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:02:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 19:02:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:02:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:02:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:02:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:02:41 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 19:02:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 19:02:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:02:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:02:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:02:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:02:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:02:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:02:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:02:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:02:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:02:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:03:02 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:03:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:03:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:03:02 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:03:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:03:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:03:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:03:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:03:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:03:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:03:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:03:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:03:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:03:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:03:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:03:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:03:10 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:03:11 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:03:11 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:03:11 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=23.516788482666016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:03:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:03:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:03:11 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:03:11 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:03:11 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:03:11 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:03:11 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:03:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:03:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:03:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:03:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:03:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:03:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:03:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:03:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:04:03 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:04:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:04:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:04:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:04:04 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:04:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:04:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:04:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:04:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:04:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:04:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:04:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:04:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:04:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:04:11 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:04:11 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:04:11 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:04:11 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=23.548324584960938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:04:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:04:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:04:12 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:04:12 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:04:12 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:04:12 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:04:12 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:04:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:04:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:04:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:04:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:04:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:04:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:04:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:04:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:04:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:27 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:04:37 user nova-compute[72000]: INFO nova.compute.claims [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Claim successful on node user
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.network.neutron [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:04:37 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.compute.manager [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:04:37 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Creating image(s)
Aug 16 19:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "/opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "/opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "48114aaa768e30c9d07ac446d9f0910915b2611c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "48114aaa768e30c9d07ac446d9f0910915b2611c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:04:37 user nova-compute[72000]: DEBUG nova.policy [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2175aa851a344dc980b29592663bade0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76bc27d354449d1aa93c1da375f432d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c.part --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c.part --force-share --output=json" returned: 0 in 0.183s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG nova.virt.images [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] 6043d628-8a82-456c-a316-f6b7de37feb1 was qcow2, converting to raw {{(pid=72000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c.part /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c.converted {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG nova.network.neutron [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Successfully created port: 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c.part /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c.converted" returned: 0 in 0.236s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c.converted --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "48114aaa768e30c9d07ac446d9f0910915b2611c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.975s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "48114aaa768e30c9d07ac446d9f0910915b2611c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "48114aaa768e30c9d07ac446d9f0910915b2611c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:04:38 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c --force-share --output=json" returned: 0 in 0.194s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c,backing_fmt=raw /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c,backing_fmt=raw /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk 1073741824" returned: 0 in 0.199s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "48114aaa768e30c9d07ac446d9f0910915b2611c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.400s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Successfully updated port: 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-f24a13e8-2f42-4af2-b79b-1084ff7963ce req-a26a372e-e5d2-46aa-a041-d60e249d0d14 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-changed-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [req-f24a13e8-2f42-4af2-b79b-1084ff7963ce req-a26a372e-e5d2-46aa-a041-d60e249d0d14 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Refreshing instance network info cache due to event network-changed-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f24a13e8-2f42-4af2-b79b-1084ff7963ce req-a26a372e-e5d2-46aa-a041-d60e249d0d14 service nova] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Cannot resize image /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'migration_context' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Ensure instance console log exists: /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.network.neutron [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.compute.manager [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Instance network_info: |[{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f24a13e8-2f42-4af2-b79b-1084ff7963ce req-a26a372e-e5d2-46aa-a041-d60e249d0d14 service nova] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.network.neutron [req-f24a13e8-2f42-4af2-b79b-1084ff7963ce req-a26a372e-e5d2-46aa-a041-d60e249d0d14 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Refreshing network info cache for port 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Start _get_guest_xml network_info=[{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:04:34Z,direct_url=<?>,disk_format='qcow2',id=6043d628-8a82-456c-a316-f6b7de37feb1,min_disk=0,min_ram=0,name='tempest-scenario-img--1861688133',owner='c76bc27d354449d1aa93c1da375f432d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:04:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6043d628-8a82-456c-a316-f6b7de37feb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:04:39 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:04:39 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:04:34Z,direct_url=<?>,disk_format='qcow2',id=6043d628-8a82-456c-a316-f6b7de37feb1,min_disk=0,min_ram=0,name='tempest-scenario-img--1861688133',owner='c76bc27d354449d1aa93c1da375f432d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:04:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-569960527',display_name='tempest-TestMinimumBasicScenario-server-569960527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-569960527',id=50,image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvJg/KbozTuC9G6rcgYV8uoWElQw2l6w+Bv736jwz5a4HbkMYtFFq3Xa0/EZkWUCZ/x7OIAIxXWZIrasdsp7ORQQiUS0n1vDiVkRPK+3y3paFV+AejOluT91JeCb2RUQw==',key_name='tempest-TestMinimumBasicScenario-1135060086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c76bc27d354449d1aa93c1da375f432d',ramdisk_id='',reservation_id='r-3h1lek90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2127783853',owner_user_name='tempest-TestMinimumBasicScenario-2127783853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:04:38Z,user_data=None,user_id='2175aa851a344dc980b29592663bade0',uuid=9f5071c8-18b9-401d-845d-b3803a684b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converting VIF {"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.objects.instance [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:04:39 user nova-compute[72000]:   <uuid>9f5071c8-18b9-401d-845d-b3803a684b2f</uuid>
Aug 16 19:04:39 user nova-compute[72000]:   <name>instance-00000032</name>
Aug 16 19:04:39 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 19:04:39 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 19:04:39 user nova-compute[72000]:   <metadata>
Aug 16 19:04:39 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:04:39 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 19:04:39 user nova-compute[72000]:       <nova:name>tempest-TestMinimumBasicScenario-server-569960527</nova:name>
Aug 16 19:04:39 user nova-compute[72000]:       <nova:creationTime>2023-08-16 19:04:39</nova:creationTime>
Aug 16 19:04:39 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 19:04:39 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 19:04:39 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 19:04:39 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 19:04:39 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:04:39 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:04:39 user nova-compute[72000]:       </nova:flavor>
Aug 16 19:04:39 user nova-compute[72000]:       <nova:owner>
Aug 16 19:04:39 user nova-compute[72000]:         <nova:user uuid="2175aa851a344dc980b29592663bade0">tempest-TestMinimumBasicScenario-2127783853-project-member</nova:user>
Aug 16 19:04:39 user nova-compute[72000]:         <nova:project uuid="c76bc27d354449d1aa93c1da375f432d">tempest-TestMinimumBasicScenario-2127783853</nova:project>
Aug 16 19:04:39 user nova-compute[72000]:       </nova:owner>
Aug 16 19:04:39 user nova-compute[72000]:       <nova:root type="image" uuid="6043d628-8a82-456c-a316-f6b7de37feb1"/>
Aug 16 19:04:39 user nova-compute[72000]:       <nova:ports>
Aug 16 19:04:39 user nova-compute[72000]:         <nova:port uuid="8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d">
Aug 16 19:04:39 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 19:04:39 user nova-compute[72000]:         </nova:port>
Aug 16 19:04:39 user nova-compute[72000]:       </nova:ports>
Aug 16 19:04:39 user nova-compute[72000]:     </nova:instance>
Aug 16 19:04:39 user nova-compute[72000]:   </metadata>
Aug 16 19:04:39 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 19:04:39 user nova-compute[72000]:     <system>
Aug 16 19:04:39 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:04:39 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:04:39 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 19:04:39 user nova-compute[72000]:       <entry name="serial">9f5071c8-18b9-401d-845d-b3803a684b2f</entry>
Aug 16 19:04:39 user nova-compute[72000]:       <entry name="uuid">9f5071c8-18b9-401d-845d-b3803a684b2f</entry>
Aug 16 19:04:39 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:04:39 user nova-compute[72000]:     </system>
Aug 16 19:04:39 user nova-compute[72000]:   </sysinfo>
Aug 16 19:04:39 user nova-compute[72000]:   <os>
Aug 16 19:04:39 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:04:39 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 19:04:39 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 19:04:39 user nova-compute[72000]:   </os>
Aug 16 19:04:39 user nova-compute[72000]:   <features>
Aug 16 19:04:39 user nova-compute[72000]:     <acpi/>
Aug 16 19:04:39 user nova-compute[72000]:     <apic/>
Aug 16 19:04:39 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 19:04:39 user nova-compute[72000]:   </features>
Aug 16 19:04:39 user nova-compute[72000]:   <clock offset="utc">
Aug 16 19:04:39 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:04:39 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:04:39 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 19:04:39 user nova-compute[72000]:   </clock>
Aug 16 19:04:39 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 19:04:39 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 19:04:39 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:04:39 user nova-compute[72000]:   </cpu>
Aug 16 19:04:39 user nova-compute[72000]:   <devices>
Aug 16 19:04:39 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 19:04:39 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:04:39 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk"/>
Aug 16 19:04:39 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 19:04:39 user nova-compute[72000]:     </disk>
Aug 16 19:04:39 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 19:04:39 user nova-compute[72000]:       <mac address="fa:16:3e:0f:02:44"/>
Aug 16 19:04:39 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 19:04:39 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 19:04:39 user nova-compute[72000]:       <target dev="tap8e40fbad-6a"/>
Aug 16 19:04:39 user nova-compute[72000]:     </interface>
Aug 16 19:04:39 user nova-compute[72000]:     <serial type="pty">
Aug 16 19:04:39 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/console.log" append="off"/>
Aug 16 19:04:39 user nova-compute[72000]:     </serial>
Aug 16 19:04:39 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:04:39 user nova-compute[72000]:     <video>
Aug 16 19:04:39 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 19:04:39 user nova-compute[72000]:     </video>
Aug 16 19:04:39 user nova-compute[72000]:     <rng model="virtio">
Aug 16 19:04:39 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:04:39 user nova-compute[72000]:     </rng>
Aug 16 19:04:39 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:04:39 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 19:04:39 user nova-compute[72000]:       <stats period="10"/>
Aug 16 19:04:39 user nova-compute[72000]:     </memballoon>
Aug 16 19:04:39 user nova-compute[72000]:   </devices>
Aug 16 19:04:39 user nova-compute[72000]: </domain>
Aug 16 19:04:39 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-569960527',display_name='tempest-TestMinimumBasicScenario-server-569960527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-569960527',id=50,image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvJg/KbozTuC9G6rcgYV8uoWElQw2l6w+Bv736jwz5a4HbkMYtFFq3Xa0/EZkWUCZ/x7OIAIxXWZIrasdsp7ORQQiUS0n1vDiVkRPK+3y3paFV+AejOluT91JeCb2RUQw==',key_name='tempest-TestMinimumBasicScenario-1135060086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c76bc27d354449d1aa93c1da375f432d',ramdisk_id='',reservation_id='r-3h1lek90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2127783853',owner_user_name='tempest-TestMinimumBasicScenario-2127783853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:04:38Z,user_data=None,user_id='2175aa851a344dc980b29592663bade0',uuid=9f5071c8-18b9-401d-845d-b3803a684b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converting VIF {"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG os_vif [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e40fbad-6a, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e40fbad-6a, col_values=(('external_ids', {'iface-id': '8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:02:44', 'vm-uuid': '9f5071c8-18b9-401d-845d-b3803a684b2f'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:39 user nova-compute[72000]: INFO os_vif [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a')
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:04:39 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] No VIF found with MAC fa:16:3e:0f:02:44, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:04:40 user nova-compute[72000]: DEBUG nova.network.neutron [req-f24a13e8-2f42-4af2-b79b-1084ff7963ce req-a26a372e-e5d2-46aa-a041-d60e249d0d14 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updated VIF entry in instance network info cache for port 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:04:40 user nova-compute[72000]: DEBUG nova.network.neutron [req-f24a13e8-2f42-4af2-b79b-1084ff7963ce req-a26a372e-e5d2-46aa-a041-d60e249d0d14 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:04:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-f24a13e8-2f42-4af2-b79b-1084ff7963ce req-a26a372e-e5d2-46aa-a041-d60e249d0d14 service nova] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:04:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-1bea6f29-5c60-43eb-8c00-ff0542815175 req-ea1a5acb-e475-4638-bc76-c2ce1553253d service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:04:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1bea6f29-5c60-43eb-8c00-ff0542815175 req-ea1a5acb-e475-4638-bc76-c2ce1553253d service nova] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:04:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1bea6f29-5c60-43eb-8c00-ff0542815175 req-ea1a5acb-e475-4638-bc76-c2ce1553253d service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:04:41 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1bea6f29-5c60-43eb-8c00-ff0542815175 req-ea1a5acb-e475-4638-bc76-c2ce1553253d service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:04:41 user nova-compute[72000]: DEBUG nova.compute.manager [req-1bea6f29-5c60-43eb-8c00-ff0542815175 req-ea1a5acb-e475-4638-bc76-c2ce1553253d service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] No waiting events found dispatching network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:04:41 user nova-compute[72000]: WARNING nova.compute.manager [req-1bea6f29-5c60-43eb-8c00-ff0542815175 req-ea1a5acb-e475-4638-bc76-c2ce1553253d service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received unexpected event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d for instance with vm_state building and task_state spawning.
Aug 16 19:04:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692212683.6736138, 9f5071c8-18b9-401d-845d-b3803a684b2f => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:04:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] VM Resumed (Lifecycle Event)
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:04:43 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Instance spawned successfully.
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:04:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692212683.6751378, 9f5071c8-18b9-401d-845d-b3803a684b2f => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:04:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] VM Started (Lifecycle Event)
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:04:43 user nova-compute[72000]: INFO nova.compute.manager [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:04:43 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-a22f9c3f-478e-418b-865b-f8c6d5dd12d5 req-397265e1-4153-4b28-b188-c3616bdd8c03 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a22f9c3f-478e-418b-865b-f8c6d5dd12d5 req-397265e1-4153-4b28-b188-c3616bdd8c03 service nova] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a22f9c3f-478e-418b-865b-f8c6d5dd12d5 req-397265e1-4153-4b28-b188-c3616bdd8c03 service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-a22f9c3f-478e-418b-865b-f8c6d5dd12d5 req-397265e1-4153-4b28-b188-c3616bdd8c03 service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:04:43 user nova-compute[72000]: DEBUG nova.compute.manager [req-a22f9c3f-478e-418b-865b-f8c6d5dd12d5 req-397265e1-4153-4b28-b188-c3616bdd8c03 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] No waiting events found dispatching network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:04:43 user nova-compute[72000]: WARNING nova.compute.manager [req-a22f9c3f-478e-418b-865b-f8c6d5dd12d5 req-397265e1-4153-4b28-b188-c3616bdd8c03 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received unexpected event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d for instance with vm_state building and task_state spawning.
Aug 16 19:04:43 user nova-compute[72000]: INFO nova.compute.manager [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Took 6.59 seconds to build instance.
Aug 16 19:04:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-881d84c4-131d-40b4-b74e-168a3af4b9fe tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.682s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:04:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:04:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:04:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:04:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:04:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:04:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:05:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:05:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:05:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:05:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:05:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:05:05 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:05:05 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:05:06 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:05:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:05:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:05:06 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:05:06 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:05:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:05:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:05:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:05:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:05:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:05:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:05:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:05:12 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:05:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:05:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:05:12 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:05:13 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:05:13 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:05:13 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:05:13 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=23.449230194091797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:05:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:05:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:05:13 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 9f5071c8-18b9-401d-845d-b3803a684b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:05:13 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:05:13 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:05:13 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:05:13 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:05:13 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:05:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:05:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:05:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:05:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:05:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:05:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:05:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:05:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:05:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:05:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:05:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:05:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:05:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:05:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:05:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:05:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:05:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:05:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:06:04 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:06:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:06 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:06:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:06:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:06:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:06:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:06:06 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:06:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:06:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:06:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:06:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:06:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:06:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:06:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:06:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:06:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:06:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:06:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:06:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:06:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:06:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:06:14 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:06:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:14 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:15 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:06:15 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:06:15 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=23.448589324951172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 9f5071c8-18b9-401d-845d-b3803a684b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:06:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:06:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:06:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:06:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:06:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:06:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:06:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:06:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:06:31 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'flavor' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:06:31 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:06:31 user nova-compute[72000]: INFO nova.compute.manager [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Attaching volume 28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da to /dev/vdb
Aug 16 19:06:32 user nova-compute[72000]: DEBUG os_brick.utils [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bff517-803a-4e85-913a-69c746ba6a6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb35e3c-ca00-4a3c-8bd7-d442ca602689]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f2ca87-7377-49fe-af5d-0855f1e52e6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7c7b7c-2494-4bf0-abf6-0a4c62810ca2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:06:32 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:06:32 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2229ba4-a5f0-4773-9f4e-788f1843b2d3]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG os_brick.utils [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:06:32 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating existing volume attachment record: 3f4571a5-c5cf-4cfc-8f17-b30b43cdfdef {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:06:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:06:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:06:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:06:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:06:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:06:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkURKAao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:06:42 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:06:42 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:06:42 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[374117f1-81fc-4762-b071-db8bcd431c5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 19:06:42 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f93272-2a01-48d2-a7be-7554438c3a4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da] added
Aug 16 19:06:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b97d477-a8a3-48e9-ada7-16b17cf8965e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3894a849-ee47-449a-a19d-97ddbb5d0531]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkURKAao {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkURKAao" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[42789e4b-cd6b-4d79-adc3-2b9f603e4107]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bkURKAao'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0458f255-a830-463e-b869-f59d670d4767]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[39af4d4f-b948-474c-9744-9afbaabbec3d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 19:06:42 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 19:06:42 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:06:42 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 19:06:42 user nova-compute[72000]: 
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa8798-9063-4f83-908e-77adc5cc3d38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260]
Aug 16 19:06:42 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260] successful.
Aug 16 19:06:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6061699-5d1b-4aaf-b65b-e8d5415a3778]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c420d05-92d6-4dfe-8fab-1d022f7e19fd]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)
Aug 16 19:06:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)
Aug 16 19:06:42 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3743b0-4e4c-4aee-90be-4e0dd9350e96]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 19:06:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkURKAao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 19:06:43 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:06:43 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23365356434356664', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:06:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365356434356664', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 19:06:43 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'flavor' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:06:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 19:06:43 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:06:43 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 19:06:43 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 19:06:43 user nova-compute[72000]:   <serial>28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da</serial>
Aug 16 19:06:43 user nova-compute[72000]: </disk>
Aug 16 19:06:43 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 19:06:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:06:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:06:43 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] No VIF found with MAC fa:16:3e:0f:02:44, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:06:43 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4d4a6bad-0366-4c2f-acb7-862f68b5f7d5 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.963s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:06:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:06:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:06:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-76f525e6-2b9a-4896-980c-076ce6fce1f1 req-788f42bc-5a70-4cce-a85f-5ec893fc64fb service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-changed-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:06:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-76f525e6-2b9a-4896-980c-076ce6fce1f1 req-788f42bc-5a70-4cce-a85f-5ec893fc64fb service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Refreshing instance network info cache due to event network-changed-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:06:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-76f525e6-2b9a-4896-980c-076ce6fce1f1 req-788f42bc-5a70-4cce-a85f-5ec893fc64fb service nova] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:06:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-76f525e6-2b9a-4896-980c-076ce6fce1f1 req-788f42bc-5a70-4cce-a85f-5ec893fc64fb service nova] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:06:55 user nova-compute[72000]: DEBUG nova.network.neutron [req-76f525e6-2b9a-4896-980c-076ce6fce1f1 req-788f42bc-5a70-4cce-a85f-5ec893fc64fb service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Refreshing network info cache for port 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:06:55 user nova-compute[72000]: DEBUG nova.network.neutron [req-76f525e6-2b9a-4896-980c-076ce6fce1f1 req-788f42bc-5a70-4cce-a85f-5ec893fc64fb service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updated VIF entry in instance network info cache for port 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:06:55 user nova-compute[72000]: DEBUG nova.network.neutron [req-76f525e6-2b9a-4896-980c-076ce6fce1f1 req-788f42bc-5a70-4cce-a85f-5ec893fc64fb service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:06:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-76f525e6-2b9a-4896-980c-076ce6fce1f1 req-788f42bc-5a70-4cce-a85f-5ec893fc64fb service nova] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:06:57 user nova-compute[72000]: DEBUG nova.compute.manager [req-cbe6af7f-62f5-48cc-bab9-5af117b22b8a req-5527f174-383c-42e2-bafe-0115af70bfee service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-changed-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:06:57 user nova-compute[72000]: DEBUG nova.compute.manager [req-cbe6af7f-62f5-48cc-bab9-5af117b22b8a req-5527f174-383c-42e2-bafe-0115af70bfee service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Refreshing instance network info cache due to event network-changed-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:06:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cbe6af7f-62f5-48cc-bab9-5af117b22b8a req-5527f174-383c-42e2-bafe-0115af70bfee service nova] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:06:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cbe6af7f-62f5-48cc-bab9-5af117b22b8a req-5527f174-383c-42e2-bafe-0115af70bfee service nova] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:06:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-cbe6af7f-62f5-48cc-bab9-5af117b22b8a req-5527f174-383c-42e2-bafe-0115af70bfee service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Refreshing network info cache for port 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:06:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-cbe6af7f-62f5-48cc-bab9-5af117b22b8a req-5527f174-383c-42e2-bafe-0115af70bfee service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updated VIF entry in instance network info cache for port 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:06:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-cbe6af7f-62f5-48cc-bab9-5af117b22b8a req-5527f174-383c-42e2-bafe-0115af70bfee service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:06:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-cbe6af7f-62f5-48cc-bab9-5af117b22b8a req-5527f174-383c-42e2-bafe-0115af70bfee service nova] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:06:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:07:03 user nova-compute[72000]: INFO nova.compute.manager [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Rebooting instance
Aug 16 19:07:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG nova.network.neutron [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG nova.compute.manager [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-053e4c48-9445-41b6-a8e1-b4395c923173 req-1399aabe-f29d-4a8b-8db4-2231d1c5ba8d service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-vif-unplugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-053e4c48-9445-41b6-a8e1-b4395c923173 req-1399aabe-f29d-4a8b-8db4-2231d1c5ba8d service nova] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-053e4c48-9445-41b6-a8e1-b4395c923173 req-1399aabe-f29d-4a8b-8db4-2231d1c5ba8d service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-053e4c48-9445-41b6-a8e1-b4395c923173 req-1399aabe-f29d-4a8b-8db4-2231d1c5ba8d service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:07:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-053e4c48-9445-41b6-a8e1-b4395c923173 req-1399aabe-f29d-4a8b-8db4-2231d1c5ba8d service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] No waiting events found dispatching network-vif-unplugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:07:03 user nova-compute[72000]: WARNING nova.compute.manager [req-053e4c48-9445-41b6-a8e1-b4395c923173 req-1399aabe-f29d-4a8b-8db4-2231d1c5ba8d service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received unexpected event network-vif-unplugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d for instance with vm_state active and task_state reboot_started_hard.
Aug 16 19:07:04 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Instance destroyed successfully.
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'resources' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-569960527',display_name='tempest-TestMinimumBasicScenario-server-569960527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-569960527',id=50,image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvJg/KbozTuC9G6rcgYV8uoWElQw2l6w+Bv736jwz5a4HbkMYtFFq3Xa0/EZkWUCZ/x7OIAIxXWZIrasdsp7ORQQiUS0n1vDiVkRPK+3y3paFV+AejOluT91JeCb2RUQw==',key_name='tempest-TestMinimumBasicScenario-1135060086',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:04:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c76bc27d354449d1aa93c1da375f432d',ramdisk_id='',reservation_id='r-3h1lek90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2127783853',owner_user_name='tempest-TestMinimumBasicScenario-2127783853-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:07:04Z,user_data=None,user_id='2175aa851a344dc980b29592663bade0',uuid=9f5071c8-18b9-401d-845d-b3803a684b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converting VIF {"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_vif [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e40fbad-6a, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:07:04 user nova-compute[72000]: INFO os_vif [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a')
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkURKAao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:07:04 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12b0b4e-40dc-4e63-a4e6-f3545a6a28c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a16295-4c8c-470e-8cb8-50b57a5b119d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)
Aug 16 19:07:04 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)
Aug 16 19:07:04 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0087303a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b894f928-b522-4442-9c54-6630ee320323]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b03e01-7fcd-48d3-b021-af987e2a7967]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bf94f5-2c3c-407e-8a3f-35bf6ac7d20a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0f8e71-f75c-4016-b02b-ef4c958d6cab]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[70885e37-a247-4589-bbce-120dec50184c]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --logout" returned: 0 in 0.037s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0622fc92-5b90-4e12-8075-786bc016f61c]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260]
Aug 16 19:07:04 user nova-compute[72000]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260] successful.
Aug 16 19:07:04 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[868b21e8-1cc6-4ef4-bb3f-e9cc9fa72b3e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.239s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] <== disconnect_volume: return (239ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Start _get_guest_xml network_info=[{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6043d628-8a82-456c-a316-f6b7de37feb1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6043d628-8a82-456c-a316-f6b7de37feb1'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkURKAao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9f5071c8-18b9-401d-845d-b3803a684b2f', 'attached_at': '', 'detached_at': '', 'volume_id': '28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da', 'serial': '28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da'}, 'attachment_id': '3f4571a5-c5cf-4cfc-8f17-b30b43cdfdef', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:07:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:07:04 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6043d628-8a82-456c-a316-f6b7de37feb1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkURKAao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:07:04 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:07:04 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:07:04 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffda0275-b2a6-4505-b708-606f7ff72c79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 19:07:04 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a0b723-5ebd-4bdc-827c-317cb481f282]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da] added
Aug 16 19:07:04 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[19351d4e-4cbc-48bf-8ee4-bf8103b2b16e]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3649bc71-f96a-41ab-850a-00527a2c35b2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkURKAao {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkURKAao" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a58fef-ec92-4406-bca3-6b5344cba537]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bkURKAao'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6d0397-31a7-43b8-bed9-56889dbe96c5]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d11892-c19f-4d3d-bfec-62b50c9c4689]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 19:07:04 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 19:07:04 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:07:04 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 19:07:04 user nova-compute[72000]: 
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8611a1a5-a9bc-49b1-947e-48da94ba0e16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260]
Aug 16 19:07:04 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260] successful.
Aug 16 19:07:04 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:04 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[678a2772-4840-4869-b350-e84beeef4283]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d5ea0-fb0f-4610-85f3-6c79ae5d64b5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)
Aug 16 19:07:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)
Aug 16 19:07:05 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9d550b-f2a0-477f-bfb4-b0a25b5e6305]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-ea64bc02-ed6f-4a62-bf59-421a60a2123e req-f1950245-4c3f-479e-8a38-e6a8323d2bcf service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ea64bc02-ed6f-4a62-bf59-421a60a2123e req-f1950245-4c3f-479e-8a38-e6a8323d2bcf service nova] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ea64bc02-ed6f-4a62-bf59-421a60a2123e req-f1950245-4c3f-479e-8a38-e6a8323d2bcf service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-ea64bc02-ed6f-4a62-bf59-421a60a2123e req-f1950245-4c3f-479e-8a38-e6a8323d2bcf service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:07:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-ea64bc02-ed6f-4a62-bf59-421a60a2123e req-f1950245-4c3f-479e-8a38-e6a8323d2bcf service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] No waiting events found dispatching network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:07:05 user nova-compute[72000]: WARNING nova.compute.manager [req-ea64bc02-ed6f-4a62-bf59-421a60a2123e req-f1950245-4c3f-479e-8a38-e6a8323d2bcf service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received unexpected event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d for instance with vm_state active and task_state reboot_started_hard.
Aug 16 19:07:06 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkURKAao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] <== connect_volume: return (1265ms) {'type': 'block', 'scsi_wwn': '23365356434356664', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365356434356664', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-569960527',display_name='tempest-TestMinimumBasicScenario-server-569960527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-569960527',id=50,image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvJg/KbozTuC9G6rcgYV8uoWElQw2l6w+Bv736jwz5a4HbkMYtFFq3Xa0/EZkWUCZ/x7OIAIxXWZIrasdsp7ORQQiUS0n1vDiVkRPK+3y3paFV+AejOluT91JeCb2RUQw==',key_name='tempest-TestMinimumBasicScenario-1135060086',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:04:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c76bc27d354449d1aa93c1da375f432d',ramdisk_id='',reservation_id='r-3h1lek90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2127783853',owner_user_name='tempest-TestMinimumBasicScenario-2127783853-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:07:04Z,user_data=None,user_id='2175aa851a344dc980b29592663bade0',uuid=9f5071c8-18b9-401d-845d-b3803a684b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converting VIF {"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:07:06 user nova-compute[72000]:   <uuid>9f5071c8-18b9-401d-845d-b3803a684b2f</uuid>
Aug 16 19:07:06 user nova-compute[72000]:   <name>instance-00000032</name>
Aug 16 19:07:06 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 19:07:06 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 19:07:06 user nova-compute[72000]:   <metadata>
Aug 16 19:07:06 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:07:06 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 19:07:06 user nova-compute[72000]:       <nova:name>tempest-TestMinimumBasicScenario-server-569960527</nova:name>
Aug 16 19:07:06 user nova-compute[72000]:       <nova:creationTime>2023-08-16 19:07:04</nova:creationTime>
Aug 16 19:07:06 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 19:07:06 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 19:07:06 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 19:07:06 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 19:07:06 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:07:06 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:07:06 user nova-compute[72000]:       </nova:flavor>
Aug 16 19:07:06 user nova-compute[72000]:       <nova:owner>
Aug 16 19:07:06 user nova-compute[72000]:         <nova:user uuid="2175aa851a344dc980b29592663bade0">tempest-TestMinimumBasicScenario-2127783853-project-member</nova:user>
Aug 16 19:07:06 user nova-compute[72000]:         <nova:project uuid="c76bc27d354449d1aa93c1da375f432d">tempest-TestMinimumBasicScenario-2127783853</nova:project>
Aug 16 19:07:06 user nova-compute[72000]:       </nova:owner>
Aug 16 19:07:06 user nova-compute[72000]:       <nova:root type="image" uuid="6043d628-8a82-456c-a316-f6b7de37feb1"/>
Aug 16 19:07:06 user nova-compute[72000]:       <nova:ports>
Aug 16 19:07:06 user nova-compute[72000]:         <nova:port uuid="8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d">
Aug 16 19:07:06 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 16 19:07:06 user nova-compute[72000]:         </nova:port>
Aug 16 19:07:06 user nova-compute[72000]:       </nova:ports>
Aug 16 19:07:06 user nova-compute[72000]:     </nova:instance>
Aug 16 19:07:06 user nova-compute[72000]:   </metadata>
Aug 16 19:07:06 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 19:07:06 user nova-compute[72000]:     <system>
Aug 16 19:07:06 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:07:06 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:07:06 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 19:07:06 user nova-compute[72000]:       <entry name="serial">9f5071c8-18b9-401d-845d-b3803a684b2f</entry>
Aug 16 19:07:06 user nova-compute[72000]:       <entry name="uuid">9f5071c8-18b9-401d-845d-b3803a684b2f</entry>
Aug 16 19:07:06 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:07:06 user nova-compute[72000]:     </system>
Aug 16 19:07:06 user nova-compute[72000]:   </sysinfo>
Aug 16 19:07:06 user nova-compute[72000]:   <os>
Aug 16 19:07:06 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:07:06 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 19:07:06 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 19:07:06 user nova-compute[72000]:   </os>
Aug 16 19:07:06 user nova-compute[72000]:   <features>
Aug 16 19:07:06 user nova-compute[72000]:     <acpi/>
Aug 16 19:07:06 user nova-compute[72000]:     <apic/>
Aug 16 19:07:06 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 19:07:06 user nova-compute[72000]:   </features>
Aug 16 19:07:06 user nova-compute[72000]:   <clock offset="utc">
Aug 16 19:07:06 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:07:06 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:07:06 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 19:07:06 user nova-compute[72000]:   </clock>
Aug 16 19:07:06 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 19:07:06 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 19:07:06 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:07:06 user nova-compute[72000]:   </cpu>
Aug 16 19:07:06 user nova-compute[72000]:   <devices>
Aug 16 19:07:06 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 19:07:06 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:07:06 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk"/>
Aug 16 19:07:06 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 19:07:06 user nova-compute[72000]:     </disk>
Aug 16 19:07:06 user nova-compute[72000]:     <disk type="block" device="disk">
Aug 16 19:07:06 user nova-compute[72000]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:07:06 user nova-compute[72000]:       <source dev="/dev/sdb"/>
Aug 16 19:07:06 user nova-compute[72000]:       <target dev="vdb" bus="virtio"/>
Aug 16 19:07:06 user nova-compute[72000]:       <serial>28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da</serial>
Aug 16 19:07:06 user nova-compute[72000]:     </disk>
Aug 16 19:07:06 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 19:07:06 user nova-compute[72000]:       <mac address="fa:16:3e:0f:02:44"/>
Aug 16 19:07:06 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 19:07:06 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 19:07:06 user nova-compute[72000]:       <target dev="tap8e40fbad-6a"/>
Aug 16 19:07:06 user nova-compute[72000]:     </interface>
Aug 16 19:07:06 user nova-compute[72000]:     <serial type="pty">
Aug 16 19:07:06 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/console.log" append="off"/>
Aug 16 19:07:06 user nova-compute[72000]:     </serial>
Aug 16 19:07:06 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:07:06 user nova-compute[72000]:     <video>
Aug 16 19:07:06 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 19:07:06 user nova-compute[72000]:     </video>
Aug 16 19:07:06 user nova-compute[72000]:     <rng model="virtio">
Aug 16 19:07:06 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:07:06 user nova-compute[72000]:     </rng>
Aug 16 19:07:06 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:07:06 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 19:07:06 user nova-compute[72000]:       <stats period="10"/>
Aug 16 19:07:06 user nova-compute[72000]:     </memballoon>
Aug 16 19:07:06 user nova-compute[72000]:   </devices>
Aug 16 19:07:06 user nova-compute[72000]: </domain>
Aug 16 19:07:06 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c --force-share --output=json" returned: 0 in 0.182s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Cannot resize image /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.objects.instance [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'migration_context' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-569960527',display_name='tempest-TestMinimumBasicScenario-server-569960527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-569960527',id=50,image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvJg/KbozTuC9G6rcgYV8uoWElQw2l6w+Bv736jwz5a4HbkMYtFFq3Xa0/EZkWUCZ/x7OIAIxXWZIrasdsp7ORQQiUS0n1vDiVkRPK+3y3paFV+AejOluT91JeCb2RUQw==',key_name='tempest-TestMinimumBasicScenario-1135060086',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:04:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c76bc27d354449d1aa93c1da375f432d',ramdisk_id='',reservation_id='r-3h1lek90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2127783853',owner_user_name='tempest-TestMinimumBasicScenario-2127783853-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:07:04Z,user_data=None,user_id='2175aa851a344dc980b29592663bade0',uuid=9f5071c8-18b9-401d-845d-b3803a684b2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converting VIF {"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG os_vif [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e40fbad-6a, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e40fbad-6a, col_values=(('external_ids', {'iface-id': '8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:02:44', 'vm-uuid': '9f5071c8-18b9-401d-845d-b3803a684b2f'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:07:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:06 user nova-compute[72000]: INFO os_vif [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a')
Aug 16 19:07:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:07:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:07:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:07:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:07:07 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-9b766edd-0810-495b-942e-e68f872af344 req-aeee14f0-e9b0-4be8-8b50-d198c05e56ad service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9b766edd-0810-495b-942e-e68f872af344 req-aeee14f0-e9b0-4be8-8b50-d198c05e56ad service nova] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9b766edd-0810-495b-942e-e68f872af344 req-aeee14f0-e9b0-4be8-8b50-d198c05e56ad service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-9b766edd-0810-495b-942e-e68f872af344 req-aeee14f0-e9b0-4be8-8b50-d198c05e56ad service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-9b766edd-0810-495b-942e-e68f872af344 req-aeee14f0-e9b0-4be8-8b50-d198c05e56ad service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] No waiting events found dispatching network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:07:08 user nova-compute[72000]: WARNING nova.compute.manager [req-9b766edd-0810-495b-942e-e68f872af344 req-aeee14f0-e9b0-4be8-8b50-d198c05e56ad service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received unexpected event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d for instance with vm_state active and task_state reboot_started_hard.
Aug 16 19:07:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for 9f5071c8-18b9-401d-845d-b3803a684b2f due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692212830.2635684, 9f5071c8-18b9-401d-845d-b3803a684b2f => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:07:10 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] VM Resumed (Lifecycle Event)
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:07:10 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Instance rebooted successfully.
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:07:10 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692212830.2656145, 9f5071c8-18b9-401d-845d-b3803a684b2f => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:07:10 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] VM Started (Lifecycle Event)
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-26ff8580-b6e0-498a-bbe4-dc5a89b0a3fd tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.207s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-8f37ddce-f7c1-48ed-b3dc-7222dd69af16 req-7289e2d3-7738-4712-8825-b4225fc7bcbf service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f37ddce-f7c1-48ed-b3dc-7222dd69af16 req-7289e2d3-7738-4712-8825-b4225fc7bcbf service nova] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f37ddce-f7c1-48ed-b3dc-7222dd69af16 req-7289e2d3-7738-4712-8825-b4225fc7bcbf service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8f37ddce-f7c1-48ed-b3dc-7222dd69af16 req-7289e2d3-7738-4712-8825-b4225fc7bcbf service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:07:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-8f37ddce-f7c1-48ed-b3dc-7222dd69af16 req-7289e2d3-7738-4712-8825-b4225fc7bcbf service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] No waiting events found dispatching network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:07:10 user nova-compute[72000]: WARNING nova.compute.manager [req-8f37ddce-f7c1-48ed-b3dc-7222dd69af16 req-7289e2d3-7738-4712-8825-b4225fc7bcbf service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received unexpected event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d for instance with vm_state active and task_state None.
Aug 16 19:07:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:07:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:07:15 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:15 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 19:07:16 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:07:16 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8830MB free_disk=23.446460723876953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 9f5071c8-18b9-401d-845d-b3803a684b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:07:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 19:07:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:41 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:07:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 19:07:41 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 19:07:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:07:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:08:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:08:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:08:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:08:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:05 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:08:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:08:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:08:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:08:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:08:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:08:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:08:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:08:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:08:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:08:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:08:08 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:08:08 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:08:09 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:08:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:08:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:08:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:08:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:08:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:08:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 19:08:17 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:08:17 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:08:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=23.44567108154297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 9f5071c8-18b9-401d-845d-b3803a684b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:08:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:08:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:08:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:08:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:08:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:08:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:08:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:08:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:08:28 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 19:08:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:08:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:08:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:08:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:08:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:08:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:08:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:08:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:08:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-7bea4be0-3f05-4980-b8b4-813b0c6fedac req-6e06a9cf-ea26-4c29-a18a-d0f0c96eb541 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-changed-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:08:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-7bea4be0-3f05-4980-b8b4-813b0c6fedac req-6e06a9cf-ea26-4c29-a18a-d0f0c96eb541 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Refreshing instance network info cache due to event network-changed-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:08:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7bea4be0-3f05-4980-b8b4-813b0c6fedac req-6e06a9cf-ea26-4c29-a18a-d0f0c96eb541 service nova] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:08:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7bea4be0-3f05-4980-b8b4-813b0c6fedac req-6e06a9cf-ea26-4c29-a18a-d0f0c96eb541 service nova] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:08:55 user nova-compute[72000]: DEBUG nova.network.neutron [req-7bea4be0-3f05-4980-b8b4-813b0c6fedac req-6e06a9cf-ea26-4c29-a18a-d0f0c96eb541 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Refreshing network info cache for port 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:08:55 user nova-compute[72000]: DEBUG nova.network.neutron [req-7bea4be0-3f05-4980-b8b4-813b0c6fedac req-6e06a9cf-ea26-4c29-a18a-d0f0c96eb541 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updated VIF entry in instance network info cache for port 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:08:55 user nova-compute[72000]: DEBUG nova.network.neutron [req-7bea4be0-3f05-4980-b8b4-813b0c6fedac req-6e06a9cf-ea26-4c29-a18a-d0f0c96eb541 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7bea4be0-3f05-4980-b8b4-813b0c6fedac req-6e06a9cf-ea26-4c29-a18a-d0f0c96eb541 service nova] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG nova.compute.manager [req-c32b07d5-fd10-443b-8510-bdab3b51d8a3 req-99968571-84fa-4cd4-91af-215ef230f4b2 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-changed-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG nova.compute.manager [req-c32b07d5-fd10-443b-8510-bdab3b51d8a3 req-99968571-84fa-4cd4-91af-215ef230f4b2 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Refreshing instance network info cache due to event network-changed-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c32b07d5-fd10-443b-8510-bdab3b51d8a3 req-99968571-84fa-4cd4-91af-215ef230f4b2 service nova] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c32b07d5-fd10-443b-8510-bdab3b51d8a3 req-99968571-84fa-4cd4-91af-215ef230f4b2 service nova] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG nova.network.neutron [req-c32b07d5-fd10-443b-8510-bdab3b51d8a3 req-99968571-84fa-4cd4-91af-215ef230f4b2 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Refreshing network info cache for port 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:08:56 user nova-compute[72000]: INFO nova.compute.manager [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Detaching volume 28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da
Aug 16 19:08:56 user nova-compute[72000]: INFO nova.virt.block_device [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Attempting to driver detach volume 28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da from mountpoint /dev/vdb
Aug 16 19:08:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Attempting to detach device vdb from instance 9f5071c8-18b9-401d-845d-b3803a684b2f from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 19:08:56 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:08:56 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 19:08:56 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 19:08:56 user nova-compute[72000]:   <serial>28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da</serial>
Aug 16 19:08:56 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 19:08:56 user nova-compute[72000]: </disk>
Aug 16 19:08:56 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 19:08:56 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Successfully detached device vdb from instance 9f5071c8-18b9-401d-845d-b3803a684b2f from the persistent domain config.
Aug 16 19:08:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9f5071c8-18b9-401d-845d-b3803a684b2f from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 19:08:56 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:08:56 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 19:08:56 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 19:08:56 user nova-compute[72000]:   <serial>28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da</serial>
Aug 16 19:08:56 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 16 19:08:56 user nova-compute[72000]: </disk>
Aug 16 19:08:56 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG nova.network.neutron [req-c32b07d5-fd10-443b-8510-bdab3b51d8a3 req-99968571-84fa-4cd4-91af-215ef230f4b2 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updated VIF entry in instance network info cache for port 8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG nova.network.neutron [req-c32b07d5-fd10-443b-8510-bdab3b51d8a3 req-99968571-84fa-4cd4-91af-215ef230f4b2 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c32b07d5-fd10-443b-8510-bdab3b51d8a3 req-99968571-84fa-4cd4-91af-215ef230f4b2 service nova] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:08:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692212937.0130394, 9f5071c8-18b9-401d-845d-b3803a684b2f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 19:08:57 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Successfully detached device vdb from instance 9f5071c8-18b9-401d-845d-b3803a684b2f from the live domain config.
Aug 16 19:08:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkURKAao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:08:57 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca10e9a8-b4f9-470d-b9c7-2b560cf3e351]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01d81d3-49bf-4e90-84a4-3f79ccd95e6d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)
Aug 16 19:08:57 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da (non-flash)
Aug 16 19:08:57 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd01f474310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c24f266-73eb-4ae6-a859-07d19f5620f4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9d4b8c-40e9-48be-bbac-32bab2047da3]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[983c987c-5d67-41fc-8773-5074a2d79821]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d108db-d27f-4d69-8f15-48f9590ffec2]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5bf628-da1a-4d7d-b1d3-672af41d237b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab94876-7af7-4ff8-8923-b5b65d71288d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260]
Aug 16 19:08:57 user nova-compute[72000]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da, portal: 172.16.0.220,3260] successful.
Aug 16 19:08:57 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28c9c8f4-1dc1-49ec-ba82-2e5ff6a913da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ef4ee3-2fc8-40a5-9415-9a822f3946b3]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] <== disconnect_volume: return (289ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:08:57 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 19:08:58 user nova-compute[72000]: DEBUG nova.objects.instance [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'flavor' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:08:58 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-674a0f6c-a691-474b-8cf7-e992522476ed tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.646s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:09:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:09:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:09:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:09:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:09:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:09:08 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:09:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:09:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:09:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:09:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:09:08 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:09:08 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:09:09 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [{"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:09:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-9f5071c8-18b9-401d-845d-b3803a684b2f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:09:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:09:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:09:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:09:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:09:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:09:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:09:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:09:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:09:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:09:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:09:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:09:16 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:09:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:09:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:09:16 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:09:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:09:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:09:17 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:09:17 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:09:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=23.444896697998047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:09:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:09:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:09:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 9f5071c8-18b9-401d-845d-b3803a684b2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:09:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:09:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:09:17 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:09:17 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:09:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:09:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:09:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:09:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:09:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:09:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:09:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:09:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:09:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:09:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:09:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:09:53 user nova-compute[72000]: INFO nova.compute.manager [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Terminating instance
Aug 16 19:09:53 user nova-compute[72000]: DEBUG nova.compute.manager [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-20974ceb-4d9e-4283-9f94-94899afabc61 req-3c513aff-ce9b-4219-af46-23121f86f78b service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-vif-unplugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-20974ceb-4d9e-4283-9f94-94899afabc61 req-3c513aff-ce9b-4219-af46-23121f86f78b service nova] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-20974ceb-4d9e-4283-9f94-94899afabc61 req-3c513aff-ce9b-4219-af46-23121f86f78b service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-20974ceb-4d9e-4283-9f94-94899afabc61 req-3c513aff-ce9b-4219-af46-23121f86f78b service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-20974ceb-4d9e-4283-9f94-94899afabc61 req-3c513aff-ce9b-4219-af46-23121f86f78b service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] No waiting events found dispatching network-vif-unplugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:09:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-20974ceb-4d9e-4283-9f94-94899afabc61 req-3c513aff-ce9b-4219-af46-23121f86f78b service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-vif-unplugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Instance destroyed successfully.
Aug 16 19:09:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'resources' on Instance uuid 9f5071c8-18b9-401d-845d-b3803a684b2f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:04:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-569960527',display_name='tempest-TestMinimumBasicScenario-server-569960527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-569960527',id=50,image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvJg/KbozTuC9G6rcgYV8uoWElQw2l6w+Bv736jwz5a4HbkMYtFFq3Xa0/EZkWUCZ/x7OIAIxXWZIrasdsp7ORQQiUS0n1vDiVkRPK+3y3paFV+AejOluT91JeCb2RUQw==',key_name='tempest-TestMinimumBasicScenario-1135060086',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:04:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c76bc27d354449d1aa93c1da375f432d',ramdisk_id='',reservation_id='r-3h1lek90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6043d628-8a82-456c-a316-f6b7de37feb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2127783853',owner_user_name='tempest-TestMinimumBasicScenario-2127783853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:07:10Z,user_data=None,user_id='2175aa851a344dc980b29592663bade0',uuid=9f5071c8-18b9-401d-845d-b3803a684b2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converting VIF {"id": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "address": "fa:16:3e:0f:02:44", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e40fbad-6a", "ovs_interfaceid": "8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG os_vif [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e40fbad-6a, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:09:54 user nova-compute[72000]: INFO os_vif [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:02:44,bridge_name='br-int',has_traffic_filtering=True,id=8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e40fbad-6a')
Aug 16 19:09:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Deleting instance files /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f_del
Aug 16 19:09:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Deletion of /opt/stack/data/nova/instances/9f5071c8-18b9-401d-845d-b3803a684b2f_del complete
Aug 16 19:09:54 user nova-compute[72000]: INFO nova.compute.manager [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 16 19:09:54 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:09:54 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Took 0.49 seconds to deallocate network for instance.
Aug 16 19:09:54 user nova-compute[72000]: DEBUG nova.compute.manager [req-cde94011-e927-4135-9fa5-35ec01f863e6 req-0178459e-d9c3-47e1-8ab3-749e2f8679f3 service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-vif-deleted-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:09:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:09:55 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:09:55 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:09:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:09:55 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Deleted allocations for instance 9f5071c8-18b9-401d-845d-b3803a684b2f
Aug 16 19:09:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-c9d7c894-cacc-461a-a825-d899febb85af tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.675s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:09:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-c08d8996-77f3-4365-b703-3669163a18d1 req-119f1bfa-3db7-4026-902c-05df82381cec service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:09:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c08d8996-77f3-4365-b703-3669163a18d1 req-119f1bfa-3db7-4026-902c-05df82381cec service nova] Acquiring lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:09:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c08d8996-77f3-4365-b703-3669163a18d1 req-119f1bfa-3db7-4026-902c-05df82381cec service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:09:55 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c08d8996-77f3-4365-b703-3669163a18d1 req-119f1bfa-3db7-4026-902c-05df82381cec service nova] Lock "9f5071c8-18b9-401d-845d-b3803a684b2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:09:55 user nova-compute[72000]: DEBUG nova.compute.manager [req-c08d8996-77f3-4365-b703-3669163a18d1 req-119f1bfa-3db7-4026-902c-05df82381cec service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] No waiting events found dispatching network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:09:55 user nova-compute[72000]: WARNING nova.compute.manager [req-c08d8996-77f3-4365-b703-3669163a18d1 req-119f1bfa-3db7-4026-902c-05df82381cec service nova] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Received unexpected event network-vif-plugged-8e40fbad-6a29-45e3-8e5a-ba3bbbb6257d for instance with vm_state deleted and task_state None.
Aug 16 19:09:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:10:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:10:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:10:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:10:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:07 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:10:09 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692212994.3227043, 9f5071c8-18b9-401d-845d-b3803a684b2f => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:10:09 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] VM Stopped (Lifecycle Event)
Aug 16 19:10:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:10:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-b269ef60-365f-4d82-bbd8-c0b8712d6d79 None None] [instance: 9f5071c8-18b9-401d-845d-b3803a684b2f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:10:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:10:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:10:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:10:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:10:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:10:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:10:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:10:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:10:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:10:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:10:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:10:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:10:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:10:17 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:10:17 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:10:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=23.472240447998047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:10:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:10:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:10:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:10:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:10:18 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:10:18 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:10:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:10:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:10:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:10:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:10:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:10:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:10:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:10:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:10:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:10:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:10:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:10:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:10:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:10:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:10:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:10:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:10:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:10:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:10:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:10:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:10:47 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:10:47 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:10:47 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:10:47 user nova-compute[72000]: INFO nova.compute.claims [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Claim successful on node user
Aug 16 19:10:48 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:10:48 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:10:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG nova.policy [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2175aa851a344dc980b29592663bade0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76bc27d354449d1aa93c1da375f432d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:10:48 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Creating image(s)
Aug 16 19:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "/opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "/opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "/opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "216c4e22f95fdc66e309919cd7bef78faa85a8ae" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "216c4e22f95fdc66e309919cd7bef78faa85a8ae" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae.part --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:10:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae.part --force-share --output=json" returned: 0 in 0.190s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG nova.virt.images [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] 94f91f9e-784e-4032-a79d-aa944458bd6e was qcow2, converting to raw {{(pid=72000) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG nova.privsep.utils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72000) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae.part /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae.converted {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Successfully created port: 193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae.part /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae.converted" returned: 0 in 0.440s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae.converted --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "216c4e22f95fdc66e309919cd7bef78faa85a8ae" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.249s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "216c4e22f95fdc66e309919cd7bef78faa85a8ae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "216c4e22f95fdc66e309919cd7bef78faa85a8ae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:10:49 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae,backing_fmt=raw /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae,backing_fmt=raw /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk 1073741824" returned: 0 in 0.075s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "216c4e22f95fdc66e309919cd7bef78faa85a8ae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Successfully updated port: 193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-8ef5760b-7cf8-4780-ad95-f2ea956e1d26 req-1472c1f4-9ea8-4090-8c06-575d41119949 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-changed-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-8ef5760b-7cf8-4780-ad95-f2ea956e1d26 req-1472c1f4-9ea8-4090-8c06-575d41119949 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Refreshing instance network info cache due to event network-changed-193d10f9-b68b-48d3-80c0-63d3778978a4. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8ef5760b-7cf8-4780-ad95-f2ea956e1d26 req-1472c1f4-9ea8-4090-8c06-575d41119949 service nova] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8ef5760b-7cf8-4780-ad95-f2ea956e1d26 req-1472c1f4-9ea8-4090-8c06-575d41119949 service nova] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.neutron [req-8ef5760b-7cf8-4780-ad95-f2ea956e1d26 req-1472c1f4-9ea8-4090-8c06-575d41119949 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Refreshing network info cache for port 193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.neutron [req-8ef5760b-7cf8-4780-ad95-f2ea956e1d26 req-1472c1f4-9ea8-4090-8c06-575d41119949 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae --force-share --output=json" returned: 0 in 0.181s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Cannot resize image /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.objects.instance [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'migration_context' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.neutron [req-8ef5760b-7cf8-4780-ad95-f2ea956e1d26 req-1472c1f4-9ea8-4090-8c06-575d41119949 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Ensure instance console log exists: /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-8ef5760b-7cf8-4780-ad95-f2ea956e1d26 req-1472c1f4-9ea8-4090-8c06-575d41119949 service nova] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.neutron [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Instance network_info: |[{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Start _get_guest_xml network_info=[{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:10:45Z,direct_url=<?>,disk_format='qcow2',id=94f91f9e-784e-4032-a79d-aa944458bd6e,min_disk=0,min_ram=0,name='tempest-scenario-img--981118621',owner='c76bc27d354449d1aa93c1da375f432d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:10:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '94f91f9e-784e-4032-a79d-aa944458bd6e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:10:50 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:10:50 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T19:10:45Z,direct_url=<?>,disk_format='qcow2',id=94f91f9e-784e-4032-a79d-aa944458bd6e,min_disk=0,min_ram=0,name='tempest-scenario-img--981118621',owner='c76bc27d354449d1aa93c1da375f432d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T19:10:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1026105406',display_name='tempest-TestMinimumBasicScenario-server-1026105406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1026105406',id=51,image_ref='94f91f9e-784e-4032-a79d-aa944458bd6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Jbk5ai8BdbU+/M8SCBmtejN68QFTcmj/R0tQOy4aN9a8zMVNanHcKhePk3JfVdp8UC513diT0tVbzO/Aj6vATfVbgVmeiEGsgLiOcqXP+64+FCGlRYSeBjjIQxNut4g==',key_name='tempest-TestMinimumBasicScenario-966115735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c76bc27d354449d1aa93c1da375f432d',ramdisk_id='',reservation_id='r-3w4gq5sd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94f91f9e-784e-4032-a79d-aa944458bd6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2127783853',owner_user_name='tempest-TestMinimumBasicScenario-2127783853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:10:48Z,user_data=None,user_id='2175aa851a344dc980b29592663bade0',uuid=96141678-2f38-45b1-abe2-121884510ed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converting VIF {"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=193d10f9-b68b-48d3-80c0-63d3778978a4,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193d10f9-b6') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.objects.instance [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'pci_devices' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:10:50 user nova-compute[72000]:   <uuid>96141678-2f38-45b1-abe2-121884510ed5</uuid>
Aug 16 19:10:50 user nova-compute[72000]:   <name>instance-00000033</name>
Aug 16 19:10:50 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 19:10:50 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 19:10:50 user nova-compute[72000]:   <metadata>
Aug 16 19:10:50 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:10:50 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 19:10:50 user nova-compute[72000]:       <nova:name>tempest-TestMinimumBasicScenario-server-1026105406</nova:name>
Aug 16 19:10:50 user nova-compute[72000]:       <nova:creationTime>2023-08-16 19:10:50</nova:creationTime>
Aug 16 19:10:50 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 19:10:50 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 19:10:50 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 19:10:50 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 19:10:50 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:10:50 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:10:50 user nova-compute[72000]:       </nova:flavor>
Aug 16 19:10:50 user nova-compute[72000]:       <nova:owner>
Aug 16 19:10:50 user nova-compute[72000]:         <nova:user uuid="2175aa851a344dc980b29592663bade0">tempest-TestMinimumBasicScenario-2127783853-project-member</nova:user>
Aug 16 19:10:50 user nova-compute[72000]:         <nova:project uuid="c76bc27d354449d1aa93c1da375f432d">tempest-TestMinimumBasicScenario-2127783853</nova:project>
Aug 16 19:10:50 user nova-compute[72000]:       </nova:owner>
Aug 16 19:10:50 user nova-compute[72000]:       <nova:root type="image" uuid="94f91f9e-784e-4032-a79d-aa944458bd6e"/>
Aug 16 19:10:50 user nova-compute[72000]:       <nova:ports>
Aug 16 19:10:50 user nova-compute[72000]:         <nova:port uuid="193d10f9-b68b-48d3-80c0-63d3778978a4">
Aug 16 19:10:50 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 16 19:10:50 user nova-compute[72000]:         </nova:port>
Aug 16 19:10:50 user nova-compute[72000]:       </nova:ports>
Aug 16 19:10:50 user nova-compute[72000]:     </nova:instance>
Aug 16 19:10:50 user nova-compute[72000]:   </metadata>
Aug 16 19:10:50 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 19:10:50 user nova-compute[72000]:     <system>
Aug 16 19:10:50 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:10:50 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:10:50 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 19:10:50 user nova-compute[72000]:       <entry name="serial">96141678-2f38-45b1-abe2-121884510ed5</entry>
Aug 16 19:10:50 user nova-compute[72000]:       <entry name="uuid">96141678-2f38-45b1-abe2-121884510ed5</entry>
Aug 16 19:10:50 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:10:50 user nova-compute[72000]:     </system>
Aug 16 19:10:50 user nova-compute[72000]:   </sysinfo>
Aug 16 19:10:50 user nova-compute[72000]:   <os>
Aug 16 19:10:50 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:10:50 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 19:10:50 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 19:10:50 user nova-compute[72000]:   </os>
Aug 16 19:10:50 user nova-compute[72000]:   <features>
Aug 16 19:10:50 user nova-compute[72000]:     <acpi/>
Aug 16 19:10:50 user nova-compute[72000]:     <apic/>
Aug 16 19:10:50 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 19:10:50 user nova-compute[72000]:   </features>
Aug 16 19:10:50 user nova-compute[72000]:   <clock offset="utc">
Aug 16 19:10:50 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:10:50 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:10:50 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 19:10:50 user nova-compute[72000]:   </clock>
Aug 16 19:10:50 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 19:10:50 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 19:10:50 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:10:50 user nova-compute[72000]:   </cpu>
Aug 16 19:10:50 user nova-compute[72000]:   <devices>
Aug 16 19:10:50 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 19:10:50 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:10:50 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk"/>
Aug 16 19:10:50 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 19:10:50 user nova-compute[72000]:     </disk>
Aug 16 19:10:50 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 19:10:50 user nova-compute[72000]:       <mac address="fa:16:3e:8c:e9:d9"/>
Aug 16 19:10:50 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 19:10:50 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 19:10:50 user nova-compute[72000]:       <target dev="tap193d10f9-b6"/>
Aug 16 19:10:50 user nova-compute[72000]:     </interface>
Aug 16 19:10:50 user nova-compute[72000]:     <serial type="pty">
Aug 16 19:10:50 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/console.log" append="off"/>
Aug 16 19:10:50 user nova-compute[72000]:     </serial>
Aug 16 19:10:50 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:10:50 user nova-compute[72000]:     <video>
Aug 16 19:10:50 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 19:10:50 user nova-compute[72000]:     </video>
Aug 16 19:10:50 user nova-compute[72000]:     <rng model="virtio">
Aug 16 19:10:50 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:10:50 user nova-compute[72000]:     </rng>
Aug 16 19:10:50 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:10:50 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 19:10:50 user nova-compute[72000]:       <stats period="10"/>
Aug 16 19:10:50 user nova-compute[72000]:     </memballoon>
Aug 16 19:10:50 user nova-compute[72000]:   </devices>
Aug 16 19:10:50 user nova-compute[72000]: </domain>
Aug 16 19:10:50 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1026105406',display_name='tempest-TestMinimumBasicScenario-server-1026105406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1026105406',id=51,image_ref='94f91f9e-784e-4032-a79d-aa944458bd6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Jbk5ai8BdbU+/M8SCBmtejN68QFTcmj/R0tQOy4aN9a8zMVNanHcKhePk3JfVdp8UC513diT0tVbzO/Aj6vATfVbgVmeiEGsgLiOcqXP+64+FCGlRYSeBjjIQxNut4g==',key_name='tempest-TestMinimumBasicScenario-966115735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c76bc27d354449d1aa93c1da375f432d',ramdisk_id='',reservation_id='r-3w4gq5sd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94f91f9e-784e-4032-a79d-aa944458bd6e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2127783853',owner_user_name='tempest-TestMinimumBasicScenario-2127783853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:10:48Z,user_data=None,user_id='2175aa851a344dc980b29592663bade0',uuid=96141678-2f38-45b1-abe2-121884510ed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converting VIF {"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=193d10f9-b68b-48d3-80c0-63d3778978a4,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193d10f9-b6') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG os_vif [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=193d10f9-b68b-48d3-80c0-63d3778978a4,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193d10f9-b6') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap193d10f9-b6, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap193d10f9-b6, col_values=(('external_ids', {'iface-id': '193d10f9-b68b-48d3-80c0-63d3778978a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:e9:d9', 'vm-uuid': '96141678-2f38-45b1-abe2-121884510ed5'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:10:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:50 user nova-compute[72000]: INFO os_vif [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=193d10f9-b68b-48d3-80c0-63d3778978a4,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193d10f9-b6')
Aug 16 19:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:10:51 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] No VIF found with MAC fa:16:3e:8c:e9:d9, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:10:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-13f78fe8-1cbe-4b27-86f9-fd228cd9244e req-d55ba0e7-d1af-4707-93f8-0c7d2e985347 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-13f78fe8-1cbe-4b27-86f9-fd228cd9244e req-d55ba0e7-d1af-4707-93f8-0c7d2e985347 service nova] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-13f78fe8-1cbe-4b27-86f9-fd228cd9244e req-d55ba0e7-d1af-4707-93f8-0c7d2e985347 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:10:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-13f78fe8-1cbe-4b27-86f9-fd228cd9244e req-d55ba0e7-d1af-4707-93f8-0c7d2e985347 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:10:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-13f78fe8-1cbe-4b27-86f9-fd228cd9244e req-d55ba0e7-d1af-4707-93f8-0c7d2e985347 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] No waiting events found dispatching network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:10:52 user nova-compute[72000]: WARNING nova.compute.manager [req-13f78fe8-1cbe-4b27-86f9-fd228cd9244e req-d55ba0e7-d1af-4707-93f8-0c7d2e985347 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received unexpected event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 for instance with vm_state building and task_state spawning.
Aug 16 19:10:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:52 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692213054.3165739, 96141678-2f38-45b1-abe2-121884510ed5 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:10:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] VM Resumed (Lifecycle Event)
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:10:54 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Instance spawned successfully.
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:10:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692213054.3186376, 96141678-2f38-45b1-abe2-121884510ed5 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:10:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] VM Started (Lifecycle Event)
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:10:54 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:10:54 user nova-compute[72000]: INFO nova.compute.manager [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [req-1127b65a-07c2-4f66-8efc-10fda49d3c6c req-d1dcab3c-5b78-428a-8eb8-763a2e17fc73 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1127b65a-07c2-4f66-8efc-10fda49d3c6c req-d1dcab3c-5b78-428a-8eb8-763a2e17fc73 service nova] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1127b65a-07c2-4f66-8efc-10fda49d3c6c req-d1dcab3c-5b78-428a-8eb8-763a2e17fc73 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1127b65a-07c2-4f66-8efc-10fda49d3c6c req-d1dcab3c-5b78-428a-8eb8-763a2e17fc73 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG nova.compute.manager [req-1127b65a-07c2-4f66-8efc-10fda49d3c6c req-d1dcab3c-5b78-428a-8eb8-763a2e17fc73 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] No waiting events found dispatching network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:10:54 user nova-compute[72000]: WARNING nova.compute.manager [req-1127b65a-07c2-4f66-8efc-10fda49d3c6c req-d1dcab3c-5b78-428a-8eb8-763a2e17fc73 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received unexpected event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 for instance with vm_state building and task_state spawning.
Aug 16 19:10:54 user nova-compute[72000]: INFO nova.compute.manager [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Took 6.66 seconds to build instance.
Aug 16 19:10:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-6a8d93b9-340a-40e5-8fd4-53524b4e25aa tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.749s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:10:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:10:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:11:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:11:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:11:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:11:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:11:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:11:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:11:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:11:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:11:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:09 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:11:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:11:09 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:11:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:11:09 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:11:09 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:11:09 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:11:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:10 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:11:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:11:10 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:11:10 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:11:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:11:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:11:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:11:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:11:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:11:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:11:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:11:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:11:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:11:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:11:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:11:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:11:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:11:18 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:11:18 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:11:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8707MB free_disk=23.42290496826172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:11:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:11:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:11:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 96141678-2f38-45b1-abe2-121884510ed5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:11:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:11:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:11:18 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:11:18 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:11:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:11:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:11:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:11:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:11:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:11:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:11:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:11:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:11:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:11:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:11:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:11:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:11:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:11:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:11:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:11:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:12:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:12:11 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:12:12 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:12:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:12:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:12:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:12:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:12:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:12:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:12:17 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:12:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:17 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:18 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:12:18 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=23.421123504638672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 96141678-2f38-45b1-abe2-121884510ed5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:12:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:12:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:12:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:32 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:32 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 19:12:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:12:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:12:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG nova.objects.instance [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'flavor' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:12:42 user nova-compute[72000]: INFO nova.compute.manager [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Attaching volume 8e7f96a1-530a-4a7a-9327-eab6ad56baa1 to /dev/vdb
Aug 16 19:12:42 user nova-compute[72000]: DEBUG os_brick.utils [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[424b1147-7d1f-4fd5-8108-21d4b8226db8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6114554-b3c4-4dac-9a95-51773abc78fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e66880-cb5f-48f2-97bf-13e20d73eab0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb28841-fd93-4104-b087-574190ba3fdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:12:42 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:12:42 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee85e69c-5161-4e1f-b5c9-9db1cff0e537]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG os_brick.utils [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:12:42 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating existing volume attachment record: 2e6d66c0-bd02-4d72-8f0f-014d86776223 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:49 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:12:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 19:12:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 19:12:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgUzFoeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:12:52 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:12:52 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:12:52 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f97828-9043-41a3-9081-c21e787a024d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 19:12:52 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d02cdb-b41c-4c4b-affc-d4eb21e1a733]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1] added
Aug 16 19:12:52 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7667ef42-9eee-495d-8b5f-b241c5ea47e2]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaa9380-deab-4fc9-8c90-19c658c2d196]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CgUzFoeH {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CgUzFoeH" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a504dd-a9a0-4081-962d-bf72e69ad94d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CgUzFoeH'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[04caf725-0fe2-449c-a6bd-98f64f9d12f8]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9376a5a5-9377-43d2-8f0d-205ce7c37fad]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 19:12:52 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 19:12:52 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:12:52 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 19:12:52 user nova-compute[72000]: 
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea791ec-0073-4a52-9d27-e4fa9f15832b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1, portal: 172.16.0.220,3260]
Aug 16 19:12:52 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1, portal: 172.16.0.220,3260] successful.
Aug 16 19:12:52 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e9fab-8c2c-4a51-9595-72300f0f2a74]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8717ca3e-f3ff-4c00-8ced-76c39b8b4069]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 (non-flash)
Aug 16 19:12:52 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 (non-flash)
Aug 16 19:12:52 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae397a9-a3c3-4eee-9818-de97901ffde8]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:12:52 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 19:12:53 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 19:12:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgUzFoeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 19:12:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:12:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '26435633639613934', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:12:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435633639613934', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 19:12:53 user nova-compute[72000]: DEBUG nova.objects.instance [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'flavor' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:12:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 19:12:53 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:12:53 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 19:12:53 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 19:12:53 user nova-compute[72000]:   <serial>8e7f96a1-530a-4a7a-9327-eab6ad56baa1</serial>
Aug 16 19:12:53 user nova-compute[72000]: </disk>
Aug 16 19:12:53 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 19:12:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:12:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:12:54 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] No VIF found with MAC fa:16:3e:8c:e9:d9, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:12:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-853a19d4-31e2-4b12-ba60-cc1fabadf665 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.763s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:12:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:12:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:12:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:12:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:12:57 user nova-compute[72000]: DEBUG nova.compute.manager [req-c035f47a-c42e-4a95-bfb1-b265e5211613 req-b797e18a-cc09-4ad5-863d-9676cb1c333d service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-changed-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:12:57 user nova-compute[72000]: DEBUG nova.compute.manager [req-c035f47a-c42e-4a95-bfb1-b265e5211613 req-b797e18a-cc09-4ad5-863d-9676cb1c333d service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Refreshing instance network info cache due to event network-changed-193d10f9-b68b-48d3-80c0-63d3778978a4. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:12:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c035f47a-c42e-4a95-bfb1-b265e5211613 req-b797e18a-cc09-4ad5-863d-9676cb1c333d service nova] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:12:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c035f47a-c42e-4a95-bfb1-b265e5211613 req-b797e18a-cc09-4ad5-863d-9676cb1c333d service nova] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:12:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-c035f47a-c42e-4a95-bfb1-b265e5211613 req-b797e18a-cc09-4ad5-863d-9676cb1c333d service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Refreshing network info cache for port 193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:12:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-c035f47a-c42e-4a95-bfb1-b265e5211613 req-b797e18a-cc09-4ad5-863d-9676cb1c333d service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updated VIF entry in instance network info cache for port 193d10f9-b68b-48d3-80c0-63d3778978a4. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:12:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-c035f47a-c42e-4a95-bfb1-b265e5211613 req-b797e18a-cc09-4ad5-863d-9676cb1c333d service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:12:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c035f47a-c42e-4a95-bfb1-b265e5211613 req-b797e18a-cc09-4ad5-863d-9676cb1c333d service nova] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:12:59 user nova-compute[72000]: DEBUG nova.compute.manager [req-6bfe7748-0189-4f64-a0a6-47e681857261 req-f88dd611-7333-4989-8729-eb88aa51e655 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-changed-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:12:59 user nova-compute[72000]: DEBUG nova.compute.manager [req-6bfe7748-0189-4f64-a0a6-47e681857261 req-f88dd611-7333-4989-8729-eb88aa51e655 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Refreshing instance network info cache due to event network-changed-193d10f9-b68b-48d3-80c0-63d3778978a4. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:12:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6bfe7748-0189-4f64-a0a6-47e681857261 req-f88dd611-7333-4989-8729-eb88aa51e655 service nova] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:12:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6bfe7748-0189-4f64-a0a6-47e681857261 req-f88dd611-7333-4989-8729-eb88aa51e655 service nova] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:12:59 user nova-compute[72000]: DEBUG nova.network.neutron [req-6bfe7748-0189-4f64-a0a6-47e681857261 req-f88dd611-7333-4989-8729-eb88aa51e655 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Refreshing network info cache for port 193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:12:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:12:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:12:59 user nova-compute[72000]: INFO nova.compute.manager [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Rebooting instance
Aug 16 19:12:59 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:12:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:00 user nova-compute[72000]: DEBUG nova.network.neutron [req-6bfe7748-0189-4f64-a0a6-47e681857261 req-f88dd611-7333-4989-8729-eb88aa51e655 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updated VIF entry in instance network info cache for port 193d10f9-b68b-48d3-80c0-63d3778978a4. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:13:00 user nova-compute[72000]: DEBUG nova.network.neutron [req-6bfe7748-0189-4f64-a0a6-47e681857261 req-f88dd611-7333-4989-8729-eb88aa51e655 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:13:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6bfe7748-0189-4f64-a0a6-47e681857261 req-f88dd611-7333-4989-8729-eb88aa51e655 service nova] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:13:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:13:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:13:00 user nova-compute[72000]: DEBUG nova.network.neutron [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:13:00 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:13:00 user nova-compute[72000]: DEBUG nova.compute.manager [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:13:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-0343e95e-b1c2-4983-b135-5995e9cbc862 req-ac503d82-d8aa-4c35-a34f-bc67c92b2e0b service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-vif-unplugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0343e95e-b1c2-4983-b135-5995e9cbc862 req-ac503d82-d8aa-4c35-a34f-bc67c92b2e0b service nova] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0343e95e-b1c2-4983-b135-5995e9cbc862 req-ac503d82-d8aa-4c35-a34f-bc67c92b2e0b service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:13:03 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-0343e95e-b1c2-4983-b135-5995e9cbc862 req-ac503d82-d8aa-4c35-a34f-bc67c92b2e0b service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:13:03 user nova-compute[72000]: DEBUG nova.compute.manager [req-0343e95e-b1c2-4983-b135-5995e9cbc862 req-ac503d82-d8aa-4c35-a34f-bc67c92b2e0b service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] No waiting events found dispatching network-vif-unplugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:13:03 user nova-compute[72000]: WARNING nova.compute.manager [req-0343e95e-b1c2-4983-b135-5995e9cbc862 req-ac503d82-d8aa-4c35-a34f-bc67c92b2e0b service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received unexpected event network-vif-unplugged-193d10f9-b68b-48d3-80c0-63d3778978a4 for instance with vm_state active and task_state reboot_started.
Aug 16 19:13:03 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Instance shutdown successfully.
Aug 16 19:13:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] No waiting events found dispatching network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:13:05 user nova-compute[72000]: WARNING nova.compute.manager [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received unexpected event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 for instance with vm_state active and task_state reboot_started.
Aug 16 19:13:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG nova.compute.manager [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] No waiting events found dispatching network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:13:05 user nova-compute[72000]: WARNING nova.compute.manager [req-513eb456-8f26-4429-9453-051263ddbd06 req-5adfd5c6-f1c9-4d40-8713-b4dec6543132 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received unexpected event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 for instance with vm_state active and task_state reboot_started.
Aug 16 19:13:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Removed pending event for 96141678-2f38-45b1-abe2-121884510ed5 due to event {{(pid=72000) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692213187.2016459, 96141678-2f38-45b1-abe2-121884510ed5 => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:13:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] VM Resumed (Lifecycle Event)
Aug 16 19:13:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Instance running successfully.
Aug 16 19:13:07 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Instance soft rebooted successfully.
Aug 16 19:13:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:13:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 16 19:13:07 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692213187.2031744, 96141678-2f38-45b1-abe2-121884510ed5 => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:13:07 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] VM Started (Lifecycle Event)
Aug 16 19:13:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-73d869e9-2ef2-4617-bfb3-a9e34eb2869d tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.491s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-1d70d78a-eb49-462a-bedc-8e00976fc23c req-78773008-dd7c-460b-b946-570f33bf4cab service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1d70d78a-eb49-462a-bedc-8e00976fc23c req-78773008-dd7c-460b-b946-570f33bf4cab service nova] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1d70d78a-eb49-462a-bedc-8e00976fc23c req-78773008-dd7c-460b-b946-570f33bf4cab service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-1d70d78a-eb49-462a-bedc-8e00976fc23c req-78773008-dd7c-460b-b946-570f33bf4cab service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:13:07 user nova-compute[72000]: DEBUG nova.compute.manager [req-1d70d78a-eb49-462a-bedc-8e00976fc23c req-78773008-dd7c-460b-b946-570f33bf4cab service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] No waiting events found dispatching network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:13:07 user nova-compute[72000]: WARNING nova.compute.manager [req-1d70d78a-eb49-462a-bedc-8e00976fc23c req-78773008-dd7c-460b-b946-570f33bf4cab service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received unexpected event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 for instance with vm_state active and task_state None.
Aug 16 19:13:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:12 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:13:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:13:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:13:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:13:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:13:12 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:13:12 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:13:13 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:13:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:13:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:13:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:13:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:13:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:13:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:13:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:13:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:13:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:13:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:13:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:13:19 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:13:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:13:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:13:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 19:13:20 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:13:20 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:13:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=23.419269561767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 96141678-2f38-45b1-abe2-121884510ed5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:13:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:13:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:13:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:13:21 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:13:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:13:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:13:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:13:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:13:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:14:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:14:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:14:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:14:13 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:14:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:14:13 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:14:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:14:13 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:14:13 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:14:13 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:14:14 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:14:14 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:14:14 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:14:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:14:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:14:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:14:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:14:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:14:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:14:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:14:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:14:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:14:19 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:14:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:19 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72000) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 16 19:14:20 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:14:20 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:14:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=23.41854476928711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 96141678-2f38-45b1-abe2-121884510ed5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:14:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:14:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:14:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:14:22 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:14:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:14:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:14:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:14:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:14:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:14:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:14:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:14:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:14:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:14:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-5ea6cf9f-3124-4523-adac-294f21d4f835 req-e1267fc9-edbe-43b5-8aa9-019ab11d43de service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-changed-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:14:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-5ea6cf9f-3124-4523-adac-294f21d4f835 req-e1267fc9-edbe-43b5-8aa9-019ab11d43de service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Refreshing instance network info cache due to event network-changed-193d10f9-b68b-48d3-80c0-63d3778978a4. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:14:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5ea6cf9f-3124-4523-adac-294f21d4f835 req-e1267fc9-edbe-43b5-8aa9-019ab11d43de service nova] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:14:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5ea6cf9f-3124-4523-adac-294f21d4f835 req-e1267fc9-edbe-43b5-8aa9-019ab11d43de service nova] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:14:51 user nova-compute[72000]: DEBUG nova.network.neutron [req-5ea6cf9f-3124-4523-adac-294f21d4f835 req-e1267fc9-edbe-43b5-8aa9-019ab11d43de service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Refreshing network info cache for port 193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:14:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-5ea6cf9f-3124-4523-adac-294f21d4f835 req-e1267fc9-edbe-43b5-8aa9-019ab11d43de service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updated VIF entry in instance network info cache for port 193d10f9-b68b-48d3-80c0-63d3778978a4. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:14:52 user nova-compute[72000]: DEBUG nova.network.neutron [req-5ea6cf9f-3124-4523-adac-294f21d4f835 req-e1267fc9-edbe-43b5-8aa9-019ab11d43de service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5ea6cf9f-3124-4523-adac-294f21d4f835 req-e1267fc9-edbe-43b5-8aa9-019ab11d43de service nova] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:14:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:14:52 user nova-compute[72000]: INFO nova.compute.manager [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Detaching volume 8e7f96a1-530a-4a7a-9327-eab6ad56baa1
Aug 16 19:14:52 user nova-compute[72000]: INFO nova.virt.block_device [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Attempting to driver detach volume 8e7f96a1-530a-4a7a-9327-eab6ad56baa1 from mountpoint /dev/vdb
Aug 16 19:14:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Attempting to detach device vdb from instance 96141678-2f38-45b1-abe2-121884510ed5 from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 19:14:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 19:14:52 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:14:52 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 19:14:52 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 19:14:52 user nova-compute[72000]:   <serial>8e7f96a1-530a-4a7a-9327-eab6ad56baa1</serial>
Aug 16 19:14:52 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 19:14:52 user nova-compute[72000]: </disk>
Aug 16 19:14:52 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 19:14:52 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Successfully detached device vdb from instance 96141678-2f38-45b1-abe2-121884510ed5 from the persistent domain config.
Aug 16 19:14:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96141678-2f38-45b1-abe2-121884510ed5 from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 19:14:52 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 19:14:52 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:14:52 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 19:14:52 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 19:14:52 user nova-compute[72000]:   <serial>8e7f96a1-530a-4a7a-9327-eab6ad56baa1</serial>
Aug 16 19:14:52 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 19:14:52 user nova-compute[72000]: </disk>
Aug 16 19:14:52 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692213293.2602427, 96141678-2f38-45b1-abe2-121884510ed5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 19:14:53 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Successfully detached device vdb from instance 96141678-2f38-45b1-abe2-121884510ed5 from the live domain config.
Aug 16 19:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CgUzFoeH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:14:53 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9c6c9e-60dc-4b53-b093-72b06e701f80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc2549f-9a8c-488a-a3cf-eda6cc678314]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 (non-flash)
Aug 16 19:14:53 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 (non-flash)
Aug 16 19:14:53 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0084f20e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e60994-bfcb-49e8-87ec-3c32f7331136]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5611bb-dc19-4fb6-b753-a296136fb6ab]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92714c6-2b90-422e-b19b-522c753f8c98]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e4e9d1-c857-40da-bd1e-a1003198a23d]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[371d8cfa-87b3-4123-9bcf-ea01c380a15a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75324e0-6dda-450f-980f-53a278013b94]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1, portal: 172.16.0.220,3260]
Aug 16 19:14:53 user nova-compute[72000]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1, portal: 172.16.0.220,3260] successful.
Aug 16 19:14:53 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e7f96a1-530a-4a7a-9327-eab6ad56baa1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bba899-4367-45d3-9364-d72cc3e63d8a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] <== disconnect_volume: return (252ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-5993eff4-871c-46a5-ac38-540587c32762 req-6c9524f7-c365-4a65-af8e-55fde860c69a service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-changed-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG nova.compute.manager [req-5993eff4-871c-46a5-ac38-540587c32762 req-6c9524f7-c365-4a65-af8e-55fde860c69a service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Refreshing instance network info cache due to event network-changed-193d10f9-b68b-48d3-80c0-63d3778978a4. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5993eff4-871c-46a5-ac38-540587c32762 req-6c9524f7-c365-4a65-af8e-55fde860c69a service nova] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5993eff4-871c-46a5-ac38-540587c32762 req-6c9524f7-c365-4a65-af8e-55fde860c69a service nova] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:14:53 user nova-compute[72000]: DEBUG nova.network.neutron [req-5993eff4-871c-46a5-ac38-540587c32762 req-6c9524f7-c365-4a65-af8e-55fde860c69a service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Refreshing network info cache for port 193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:14:54 user nova-compute[72000]: DEBUG nova.network.neutron [req-5993eff4-871c-46a5-ac38-540587c32762 req-6c9524f7-c365-4a65-af8e-55fde860c69a service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updated VIF entry in instance network info cache for port 193d10f9-b68b-48d3-80c0-63d3778978a4. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:14:54 user nova-compute[72000]: DEBUG nova.network.neutron [req-5993eff4-871c-46a5-ac38-540587c32762 req-6c9524f7-c365-4a65-af8e-55fde860c69a service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:14:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5993eff4-871c-46a5-ac38-540587c32762 req-6c9524f7-c365-4a65-af8e-55fde860c69a service nova] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:14:54 user nova-compute[72000]: DEBUG nova.objects.instance [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'flavor' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:14:54 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-dab00c62-bfe7-4c1f-9ddf-ae467095f02c tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.737s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:14:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:14:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:01 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:15:06 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:11 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:15:14 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:15:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:15:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:15:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:15:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:15:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:15:15 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:15:15 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:15:15 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:15:16 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [{"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:15:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-96141678-2f38-45b1-abe2-121884510ed5" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:15:16 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:15:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:15:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:15:21 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:15:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:15:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:15:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:15:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:15:21 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:15:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:15:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:15:21 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:15:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:15:22 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:15:22 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:15:22 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=23.41775894165039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:15:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:15:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:15:22 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 96141678-2f38-45b1-abe2-121884510ed5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:15:22 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:15:22 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:15:22 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:15:22 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:15:22 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:15:22 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:15:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:15:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:15:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:15:26 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:15:31 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:36 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:41 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:46 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:15:49 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:15:49 user nova-compute[72000]: INFO nova.compute.manager [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Terminating instance
Aug 16 19:15:49 user nova-compute[72000]: DEBUG nova.compute.manager [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 19:15:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-5d809a3b-0f2f-416f-ad36-a3a03a1ace07 req-76f1a527-9c34-4def-b266-755cd8463f97 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-vif-unplugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5d809a3b-0f2f-416f-ad36-a3a03a1ace07 req-76f1a527-9c34-4def-b266-755cd8463f97 service nova] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5d809a3b-0f2f-416f-ad36-a3a03a1ace07 req-76f1a527-9c34-4def-b266-755cd8463f97 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5d809a3b-0f2f-416f-ad36-a3a03a1ace07 req-76f1a527-9c34-4def-b266-755cd8463f97 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-5d809a3b-0f2f-416f-ad36-a3a03a1ace07 req-76f1a527-9c34-4def-b266-755cd8463f97 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] No waiting events found dispatching network-vif-unplugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG nova.compute.manager [req-5d809a3b-0f2f-416f-ad36-a3a03a1ace07 req-76f1a527-9c34-4def-b266-755cd8463f97 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-vif-unplugged-193d10f9-b68b-48d3-80c0-63d3778978a4 for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 19:15:50 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Instance destroyed successfully.
Aug 16 19:15:50 user nova-compute[72000]: DEBUG nova.objects.instance [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lazy-loading 'resources' on Instance uuid 96141678-2f38-45b1-abe2-121884510ed5 {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1026105406',display_name='tempest-TestMinimumBasicScenario-server-1026105406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1026105406',id=51,image_ref='94f91f9e-784e-4032-a79d-aa944458bd6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Jbk5ai8BdbU+/M8SCBmtejN68QFTcmj/R0tQOy4aN9a8zMVNanHcKhePk3JfVdp8UC513diT0tVbzO/Aj6vATfVbgVmeiEGsgLiOcqXP+64+FCGlRYSeBjjIQxNut4g==',key_name='tempest-TestMinimumBasicScenario-966115735',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:10:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c76bc27d354449d1aa93c1da375f432d',ramdisk_id='',reservation_id='r-3w4gq5sd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94f91f9e-784e-4032-a79d-aa944458bd6e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2127783853',owner_user_name='tempest-TestMinimumBasicScenario-2127783853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:13:07Z,user_data=None,user_id='2175aa851a344dc980b29592663bade0',uuid=96141678-2f38-45b1-abe2-121884510ed5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converting VIF {"id": "193d10f9-b68b-48d3-80c0-63d3778978a4", "address": "fa:16:3e:8c:e9:d9", "network": {"id": "023e683a-e024-46ec-ad07-7355b04569d5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1294127084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c76bc27d354449d1aa93c1da375f432d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap193d10f9-b6", "ovs_interfaceid": "193d10f9-b68b-48d3-80c0-63d3778978a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=193d10f9-b68b-48d3-80c0-63d3778978a4,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193d10f9-b6') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG os_vif [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=193d10f9-b68b-48d3-80c0-63d3778978a4,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193d10f9-b6') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap193d10f9-b6, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:15:50 user nova-compute[72000]: INFO os_vif [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:e9:d9,bridge_name='br-int',has_traffic_filtering=True,id=193d10f9-b68b-48d3-80c0-63d3778978a4,network=Network(023e683a-e024-46ec-ad07-7355b04569d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap193d10f9-b6')
Aug 16 19:15:50 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Deleting instance files /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5_del
Aug 16 19:15:50 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Deletion of /opt/stack/data/nova/instances/96141678-2f38-45b1-abe2-121884510ed5_del complete
Aug 16 19:15:50 user nova-compute[72000]: INFO nova.compute.manager [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 16 19:15:50 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 19:15:50 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 96141678-2f38-45b1-abe2-121884510ed5] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 19:15:51 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:15:51 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:15:51 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Took 0.53 seconds to deallocate network for instance.
Aug 16 19:15:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:15:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:15:51 user nova-compute[72000]: DEBUG nova.compute.manager [req-d8e0bc72-944e-4536-af2b-e7a599614df5 req-4a1f971b-b430-4b6a-871f-d1fdf8496776 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-vif-deleted-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:15:51 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:15:51 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:15:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:15:51 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Deleted allocations for instance 96141678-2f38-45b1-abe2-121884510ed5
Aug 16 19:15:51 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-5691e491-0a9d-419a-a06e-dbfc43c44d64 tempest-TestMinimumBasicScenario-2127783853 tempest-TestMinimumBasicScenario-2127783853-project-member] Lock "96141678-2f38-45b1-abe2-121884510ed5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:15:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-6debb31f-acb9-4c34-8cc0-7a8a58b4b16f req-d62e903d-9176-44fc-bf1e-a960bb6ed8f7 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:15:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6debb31f-acb9-4c34-8cc0-7a8a58b4b16f req-d62e903d-9176-44fc-bf1e-a960bb6ed8f7 service nova] Acquiring lock "96141678-2f38-45b1-abe2-121884510ed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:15:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6debb31f-acb9-4c34-8cc0-7a8a58b4b16f req-d62e903d-9176-44fc-bf1e-a960bb6ed8f7 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:15:52 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-6debb31f-acb9-4c34-8cc0-7a8a58b4b16f req-d62e903d-9176-44fc-bf1e-a960bb6ed8f7 service nova] Lock "96141678-2f38-45b1-abe2-121884510ed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:15:52 user nova-compute[72000]: DEBUG nova.compute.manager [req-6debb31f-acb9-4c34-8cc0-7a8a58b4b16f req-d62e903d-9176-44fc-bf1e-a960bb6ed8f7 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] No waiting events found dispatching network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:15:52 user nova-compute[72000]: WARNING nova.compute.manager [req-6debb31f-acb9-4c34-8cc0-7a8a58b4b16f req-d62e903d-9176-44fc-bf1e-a960bb6ed8f7 service nova] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Received unexpected event network-vif-plugged-193d10f9-b68b-48d3-80c0-63d3778978a4 for instance with vm_state deleted and task_state None.
Aug 16 19:15:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:16:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:16:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:16:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:16:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:05 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692213350.5439155, 96141678-2f38-45b1-abe2-121884510ed5 => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:16:05 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 96141678-2f38-45b1-abe2-121884510ed5] VM Stopped (Lifecycle Event)
Aug 16 19:16:05 user nova-compute[72000]: DEBUG nova.compute.manager [None req-487611ce-1e85-48d3-a082-32b5b2fc82f9 None None] [instance: 96141678-2f38-45b1-abe2-121884510ed5] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:16:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:16:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:16:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:16:15 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:16:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:16:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:16:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:16:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:16:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:16:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:16:23 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:16:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:16:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:16:23 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:16:24 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:16:24 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:16:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=23.437259674072266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:16:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:16:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:16:24 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:16:24 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:16:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:16:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:16:25 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:16:30 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:16:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:16:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:16:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:16:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:16:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:16:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:16:42 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:47 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:50 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:55 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:56 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:16:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Starting instance... {{(pid=72000) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72000) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 16 19:17:06 user nova-compute[72000]: INFO nova.compute.claims [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Claim successful on node user
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.176s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Start building networks asynchronously for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Allocating IP information in the background. {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] allocate_for_instance() {{(pid=72000) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 16 19:17:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Start building block device mappings for instance. {{(pid=72000) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.policy [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dec782e22a546818eebc76df9f12f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b6e1dd48d74e0fa07bd8f137f6e297', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72000) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Start spawning the instance on the hypervisor. {{(pid=72000) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Creating instance directory {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 16 19:17:06 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Creating image(s)
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "/opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "/opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "/opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.177s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:06 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk 1073741824 {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56,backing_fmt=raw /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk 1073741824" returned: 0 in 0.067s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Successfully created port: 7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 --force-share --output=json" returned: 0 in 0.188s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk. size=1073741824 {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG nova.virt.disk.api [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Cannot resize image /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk to a smaller size. {{(pid=72000) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lazy-loading 'migration_context' on Instance uuid 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Created local disks {{(pid=72000) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Ensure instance console log exists: /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/console.log {{(pid=72000) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:07 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Successfully updated port: 7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquired lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Building network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-c9ca99ab-24ed-444d-a684-bf17d7f46f41 req-5755ee64-ec69-46ce-90fe-7ffdbfe67036 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-changed-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.compute.manager [req-c9ca99ab-24ed-444d-a684-bf17d7f46f41 req-5755ee64-ec69-46ce-90fe-7ffdbfe67036 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Refreshing instance network info cache due to event network-changed-7a95cb11-6dd9-40e0-a2b7-178813f4894b. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c9ca99ab-24ed-444d-a684-bf17d7f46f41 req-5755ee64-ec69-46ce-90fe-7ffdbfe67036 service nova] Acquiring lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Instance cache missing network info. {{(pid=72000) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.neutron [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updating instance_info_cache with network_info: [{"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Releasing lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Instance network_info: |[{"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72000) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c9ca99ab-24ed-444d-a684-bf17d7f46f41 req-5755ee64-ec69-46ce-90fe-7ffdbfe67036 service nova] Acquired lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-c9ca99ab-24ed-444d-a684-bf17d7f46f41 req-5755ee64-ec69-46ce-90fe-7ffdbfe67036 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Refreshing network info cache for port 7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Start _get_guest_xml network_info=[{"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'c19ae381-62a6-4e07-8c3a-fefacf5c24ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 16 19:17:08 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:17:08 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] CPU controller missing on host. {{(pid=72000) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.host [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] CPU controller found on host. {{(pid=72000) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72000) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-16T17:56:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-16T17:56:32Z,direct_url=<?>,disk_format='qcow2',id=c19ae381-62a6-4e07-8c3a-fefacf5c24ea,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6a9b1e19a41b48d58c2fc8559ff091a9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-16T17:56:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Flavor limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Image limits 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Flavor pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Image pref 0:0:0 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72000) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Got 1 possible topologies {{(pid=72000) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.hardware [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72000) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1135173549',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1135173549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1135173',id=52,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoRCh/iZiDgxuBnH4kLni55sJeahpOa+SJekMgfv6hBELKmFWD+98SPuI+z6HmzLqDm7qeD9j/abso92C9DTUydYVRWL0qAVsueUkMMQCLr6eyQ2gvumCA1xnHne6YeEQ==',key_name='tempest-keypair-1997659152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1b6e1dd48d74e0fa07bd8f137f6e297',ramdisk_id='',reservation_id='r-o9l6grra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1616600434',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:17:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dec782e22a546818eebc76df9f12f79',uuid=991f28f8-9d8a-4fbe-941a-3e0803d0d16f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72000) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Converting VIF {"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:64:4c,bridge_name='br-int',has_traffic_filtering=True,id=7a95cb11-6dd9-40e0-a2b7-178813f4894b,network=Network(fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a95cb11-6d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.objects.instance [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lazy-loading 'pci_devices' on Instance uuid 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] End _get_guest_xml xml=<domain type="kvm">
Aug 16 19:17:08 user nova-compute[72000]:   <uuid>991f28f8-9d8a-4fbe-941a-3e0803d0d16f</uuid>
Aug 16 19:17:08 user nova-compute[72000]:   <name>instance-00000034</name>
Aug 16 19:17:08 user nova-compute[72000]:   <memory>524288</memory>
Aug 16 19:17:08 user nova-compute[72000]:   <vcpu>1</vcpu>
Aug 16 19:17:08 user nova-compute[72000]:   <metadata>
Aug 16 19:17:08 user nova-compute[72000]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 16 19:17:08 user nova-compute[72000]:       <nova:package version="0.0.0"/>
Aug 16 19:17:08 user nova-compute[72000]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1135173549</nova:name>
Aug 16 19:17:08 user nova-compute[72000]:       <nova:creationTime>2023-08-16 19:17:08</nova:creationTime>
Aug 16 19:17:08 user nova-compute[72000]:       <nova:flavor name="m1.tiny">
Aug 16 19:17:08 user nova-compute[72000]:         <nova:memory>512</nova:memory>
Aug 16 19:17:08 user nova-compute[72000]:         <nova:disk>1</nova:disk>
Aug 16 19:17:08 user nova-compute[72000]:         <nova:swap>0</nova:swap>
Aug 16 19:17:08 user nova-compute[72000]:         <nova:ephemeral>0</nova:ephemeral>
Aug 16 19:17:08 user nova-compute[72000]:         <nova:vcpus>1</nova:vcpus>
Aug 16 19:17:08 user nova-compute[72000]:       </nova:flavor>
Aug 16 19:17:08 user nova-compute[72000]:       <nova:owner>
Aug 16 19:17:08 user nova-compute[72000]:         <nova:user uuid="2dec782e22a546818eebc76df9f12f79">tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member</nova:user>
Aug 16 19:17:08 user nova-compute[72000]:         <nova:project uuid="a1b6e1dd48d74e0fa07bd8f137f6e297">tempest-TestServerVolumeAttachScenarioOldVersion-1616600434</nova:project>
Aug 16 19:17:08 user nova-compute[72000]:       </nova:owner>
Aug 16 19:17:08 user nova-compute[72000]:       <nova:root type="image" uuid="c19ae381-62a6-4e07-8c3a-fefacf5c24ea"/>
Aug 16 19:17:08 user nova-compute[72000]:       <nova:ports>
Aug 16 19:17:08 user nova-compute[72000]:         <nova:port uuid="7a95cb11-6dd9-40e0-a2b7-178813f4894b">
Aug 16 19:17:08 user nova-compute[72000]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 16 19:17:08 user nova-compute[72000]:         </nova:port>
Aug 16 19:17:08 user nova-compute[72000]:       </nova:ports>
Aug 16 19:17:08 user nova-compute[72000]:     </nova:instance>
Aug 16 19:17:08 user nova-compute[72000]:   </metadata>
Aug 16 19:17:08 user nova-compute[72000]:   <sysinfo type="smbios">
Aug 16 19:17:08 user nova-compute[72000]:     <system>
Aug 16 19:17:08 user nova-compute[72000]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 16 19:17:08 user nova-compute[72000]:       <entry name="product">OpenStack Nova</entry>
Aug 16 19:17:08 user nova-compute[72000]:       <entry name="version">0.0.0</entry>
Aug 16 19:17:08 user nova-compute[72000]:       <entry name="serial">991f28f8-9d8a-4fbe-941a-3e0803d0d16f</entry>
Aug 16 19:17:08 user nova-compute[72000]:       <entry name="uuid">991f28f8-9d8a-4fbe-941a-3e0803d0d16f</entry>
Aug 16 19:17:08 user nova-compute[72000]:       <entry name="family">Virtual Machine</entry>
Aug 16 19:17:08 user nova-compute[72000]:     </system>
Aug 16 19:17:08 user nova-compute[72000]:   </sysinfo>
Aug 16 19:17:08 user nova-compute[72000]:   <os>
Aug 16 19:17:08 user nova-compute[72000]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 16 19:17:08 user nova-compute[72000]:     <boot dev="hd"/>
Aug 16 19:17:08 user nova-compute[72000]:     <smbios mode="sysinfo"/>
Aug 16 19:17:08 user nova-compute[72000]:   </os>
Aug 16 19:17:08 user nova-compute[72000]:   <features>
Aug 16 19:17:08 user nova-compute[72000]:     <acpi/>
Aug 16 19:17:08 user nova-compute[72000]:     <apic/>
Aug 16 19:17:08 user nova-compute[72000]:     <vmcoreinfo/>
Aug 16 19:17:08 user nova-compute[72000]:   </features>
Aug 16 19:17:08 user nova-compute[72000]:   <clock offset="utc">
Aug 16 19:17:08 user nova-compute[72000]:     <timer name="pit" tickpolicy="delay"/>
Aug 16 19:17:08 user nova-compute[72000]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 16 19:17:08 user nova-compute[72000]:     <timer name="hpet" present="no"/>
Aug 16 19:17:08 user nova-compute[72000]:   </clock>
Aug 16 19:17:08 user nova-compute[72000]:   <cpu mode="custom" match="exact">
Aug 16 19:17:08 user nova-compute[72000]:     <model>Nehalem</model>
Aug 16 19:17:08 user nova-compute[72000]:     <topology sockets="1" cores="1" threads="1"/>
Aug 16 19:17:08 user nova-compute[72000]:   </cpu>
Aug 16 19:17:08 user nova-compute[72000]:   <devices>
Aug 16 19:17:08 user nova-compute[72000]:     <disk type="file" device="disk">
Aug 16 19:17:08 user nova-compute[72000]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 16 19:17:08 user nova-compute[72000]:       <source file="/opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk"/>
Aug 16 19:17:08 user nova-compute[72000]:       <target dev="vda" bus="virtio"/>
Aug 16 19:17:08 user nova-compute[72000]:     </disk>
Aug 16 19:17:08 user nova-compute[72000]:     <interface type="ethernet">
Aug 16 19:17:08 user nova-compute[72000]:       <mac address="fa:16:3e:fd:64:4c"/>
Aug 16 19:17:08 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 19:17:08 user nova-compute[72000]:       <mtu size="1442"/>
Aug 16 19:17:08 user nova-compute[72000]:       <target dev="tap7a95cb11-6d"/>
Aug 16 19:17:08 user nova-compute[72000]:     </interface>
Aug 16 19:17:08 user nova-compute[72000]:     <serial type="pty">
Aug 16 19:17:08 user nova-compute[72000]:       <log file="/opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/console.log" append="off"/>
Aug 16 19:17:08 user nova-compute[72000]:     </serial>
Aug 16 19:17:08 user nova-compute[72000]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 16 19:17:08 user nova-compute[72000]:     <video>
Aug 16 19:17:08 user nova-compute[72000]:       <model type="virtio"/>
Aug 16 19:17:08 user nova-compute[72000]:     </video>
Aug 16 19:17:08 user nova-compute[72000]:     <rng model="virtio">
Aug 16 19:17:08 user nova-compute[72000]:       <backend model="random">/dev/urandom</backend>
Aug 16 19:17:08 user nova-compute[72000]:     </rng>
Aug 16 19:17:08 user nova-compute[72000]:     <controller type="usb" index="0" model="none"/>
Aug 16 19:17:08 user nova-compute[72000]:     <memballoon model="virtio">
Aug 16 19:17:08 user nova-compute[72000]:       <stats period="10"/>
Aug 16 19:17:08 user nova-compute[72000]:     </memballoon>
Aug 16 19:17:08 user nova-compute[72000]:   </devices>
Aug 16 19:17:08 user nova-compute[72000]: </domain>
Aug 16 19:17:08 user nova-compute[72000]:  {{(pid=72000) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1135173549',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1135173549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1135173',id=52,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoRCh/iZiDgxuBnH4kLni55sJeahpOa+SJekMgfv6hBELKmFWD+98SPuI+z6HmzLqDm7qeD9j/abso92C9DTUydYVRWL0qAVsueUkMMQCLr6eyQ2gvumCA1xnHne6YeEQ==',key_name='tempest-keypair-1997659152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1b6e1dd48d74e0fa07bd8f137f6e297',ramdisk_id='',reservation_id='r-o9l6grra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1616600434',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-16T19:17:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dec782e22a546818eebc76df9f12f79',uuid=991f28f8-9d8a-4fbe-941a-3e0803d0d16f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Converting VIF {"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:64:4c,bridge_name='br-int',has_traffic_filtering=True,id=7a95cb11-6dd9-40e0-a2b7-178813f4894b,network=Network(fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a95cb11-6d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG os_vif [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:64:4c,bridge_name='br-int',has_traffic_filtering=True,id=7a95cb11-6dd9-40e0-a2b7-178813f4894b,network=Network(fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a95cb11-6d') {{(pid=72000) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a95cb11-6d, may_exist=True, interface_attrs={}) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a95cb11-6d, col_values=(('external_ids', {'iface-id': '7a95cb11-6dd9-40e0-a2b7-178813f4894b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:64:4c', 'vm-uuid': '991f28f8-9d8a-4fbe-941a-3e0803d0d16f'}),), if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:08 user nova-compute[72000]: INFO os_vif [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:64:4c,bridge_name='br-int',has_traffic_filtering=True,id=7a95cb11-6dd9-40e0-a2b7-178813f4894b,network=Network(fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a95cb11-6d')
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] No VIF found with MAC fa:16:3e:fd:64:4c, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-c9ca99ab-24ed-444d-a684-bf17d7f46f41 req-5755ee64-ec69-46ce-90fe-7ffdbfe67036 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updated VIF entry in instance network info cache for port 7a95cb11-6dd9-40e0-a2b7-178813f4894b. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG nova.network.neutron [req-c9ca99ab-24ed-444d-a684-bf17d7f46f41 req-5755ee64-ec69-46ce-90fe-7ffdbfe67036 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updating instance_info_cache with network_info: [{"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:17:08 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-c9ca99ab-24ed-444d-a684-bf17d7f46f41 req-5755ee64-ec69-46ce-90fe-7ffdbfe67036 service nova] Releasing lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:17:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-5700e45c-aaec-4304-912d-197852463737 req-138e42b9-c752-436e-a0e4-6845cedabf7b service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:17:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5700e45c-aaec-4304-912d-197852463737 req-138e42b9-c752-436e-a0e4-6845cedabf7b service nova] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5700e45c-aaec-4304-912d-197852463737 req-138e42b9-c752-436e-a0e4-6845cedabf7b service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:10 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-5700e45c-aaec-4304-912d-197852463737 req-138e42b9-c752-436e-a0e4-6845cedabf7b service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:10 user nova-compute[72000]: DEBUG nova.compute.manager [req-5700e45c-aaec-4304-912d-197852463737 req-138e42b9-c752-436e-a0e4-6845cedabf7b service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] No waiting events found dispatching network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:17:10 user nova-compute[72000]: WARNING nova.compute.manager [req-5700e45c-aaec-4304-912d-197852463737 req-138e42b9-c752-436e-a0e4-6845cedabf7b service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received unexpected event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b for instance with vm_state building and task_state spawning.
Aug 16 19:17:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:10 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692213432.03377, 991f28f8-9d8a-4fbe-941a-3e0803d0d16f => Resumed> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] VM Resumed (Lifecycle Event)
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Instance event wait completed in 0 seconds for  {{(pid=72000) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Guest created on hypervisor {{(pid=72000) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 16 19:17:12 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Instance spawned successfully.
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Found default for hw_cdrom_bus of ide {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Found default for hw_disk_bus of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Found default for hw_input_bus of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Found default for hw_pointer_model of None {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Found default for hw_video_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Found default for hw_vif_model of virtio {{(pid=72000) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 16 19:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.virt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Emitting event <LifecycleEvent: 1692213432.0360532, 991f28f8-9d8a-4fbe-941a-3e0803d0d16f => Started> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] VM Started (Lifecycle Event)
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72000) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 16 19:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 16 19:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Took 5.36 seconds to spawn the instance on the hypervisor.
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:17:12 user nova-compute[72000]: INFO nova.compute.manager [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Took 5.92 seconds to build instance.
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-7a06a28b-8a20-4d90-adb7-67b234951c81 req-3ebb574f-bcea-4dd9-bf3d-6ba45954bc2f service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7a06a28b-8a20-4d90-adb7-67b234951c81 req-3ebb574f-bcea-4dd9-bf3d-6ba45954bc2f service nova] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7a06a28b-8a20-4d90-adb7-67b234951c81 req-3ebb574f-bcea-4dd9-bf3d-6ba45954bc2f service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-7a06a28b-8a20-4d90-adb7-67b234951c81 req-3ebb574f-bcea-4dd9-bf3d-6ba45954bc2f service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:12 user nova-compute[72000]: DEBUG nova.compute.manager [req-7a06a28b-8a20-4d90-adb7-67b234951c81 req-3ebb574f-bcea-4dd9-bf3d-6ba45954bc2f service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] No waiting events found dispatching network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:17:12 user nova-compute[72000]: WARNING nova.compute.manager [req-7a06a28b-8a20-4d90-adb7-67b234951c81 req-3ebb574f-bcea-4dd9-bf3d-6ba45954bc2f service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received unexpected event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b for instance with vm_state active and task_state None.
Aug 16 19:17:12 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-4925dc1e-b2cc-4b8c-b36d-2cb9897164bd tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.015s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:15 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:16 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:17:16 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:17:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:17:16 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:17:16 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:17:16 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:17:17 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updating instance_info_cache with network_info: [{"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:17:17 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:17:17 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:17:17 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:24 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:17:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:24 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:24 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:17:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:17:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:17:24 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:17:25 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:17:25 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:17:25 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=23.473968505859375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 991f28f8-9d8a-4fbe-941a-3e0803d0d16f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing inventories for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating ProviderTree inventory for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Updating inventory in ProviderTree for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing aggregate associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, aggregates: None {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 16 19:17:25 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Refreshing trait associations for resource provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI {{(pid=72000) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 16 19:17:26 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:17:26 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:17:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:17:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:17:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:17:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:17:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:17:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:35 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:36 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:40 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:43 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:43 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances with incomplete migration  {{(pid=72000) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 16 19:17:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:45 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:17:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:17:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:17:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:17:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:17:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Verify base images {{(pid=72000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Image id c19ae381-62a6-4e07-8c3a-fefacf5c24ea yields fingerprint e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 {{(pid=72000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] image c19ae381-62a6-4e07-8c3a-fefacf5c24ea at (/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56): checking
Aug 16 19:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] image c19ae381-62a6-4e07-8c3a-fefacf5c24ea at (/opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56): image is in use {{(pid=72000) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] 991f28f8-9d8a-4fbe-941a-3e0803d0d16f is a valid instance name {{(pid=72000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] 991f28f8-9d8a-4fbe-941a-3e0803d0d16f has a disk file {{(pid=72000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 991f28f8-9d8a-4fbe-941a-3e0803d0d16f is backed by e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56 {{(pid=72000) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 16 19:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4
Aug 16 19:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d
Aug 16 19:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae
Aug 16 19:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c
Aug 16 19:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3
Aug 16 19:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661
Aug 16 19:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39
Aug 16 19:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d
Aug 16 19:17:56 user nova-compute[72000]: WARNING nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Active base files: /opt/stack/data/nova/instances/_base/e9dbaa10f21e0d524a6f4d90e9569733c8aa4e56
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Removable base files: /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4 /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3 /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661 /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39 /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1339dc4f72f5db75633124199a4c7a0e9a7810f4
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/21a1a3346c788c822e2d7451c20b5d34d856d49d
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/216c4e22f95fdc66e309919cd7bef78faa85a8ae
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/48114aaa768e30c9d07ac446d9f0910915b2611c
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/04fb3f99df5ce85ba29b2dab08292a887ef4aff3
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4265d71a0c59697f6943d461bb921bfff9dc8661
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/14b277e53ba1f3377f7c9da73e6d850357550e39
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/208b7d5e1c7ff1435357fabeac7e381c999db84d
Aug 16 19:17:56 user nova-compute[72000]: INFO nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d3f9411387e6c499fb9399d696d5d90f14fee69
Aug 16 19:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Verification complete {{(pid=72000) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Verify swap images {{(pid=72000) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 16 19:17:56 user nova-compute[72000]: DEBUG nova.virt.libvirt.imagecache [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Verify ephemeral images {{(pid=72000) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 16 19:17:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:01 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Cleaning up deleted instances {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 16 19:18:01 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] There are 0 instances to clean {{(pid=72000) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 16 19:18:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:18:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:18:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:18:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:19 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updating instance_info_cache with network_info: [{"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:18:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:18:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:18:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:18:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:18:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:18:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:18:26 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:18:26 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:18:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:18:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:18:26 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:18:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:18:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:18:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:18:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=23.445537567138672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:18:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:18:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:18:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 991f28f8-9d8a-4fbe-941a-3e0803d0d16f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:18:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:18:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:18:27 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:18:27 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:18:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:18:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:18:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:29 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:33 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:18:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:40 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_power_states {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:18:40 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Triggering sync for uuid 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 16 19:18:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:18:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:18:40 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:18:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:18:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:18:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:57 user nova-compute[72000]: DEBUG nova.compute.manager [req-41c587e9-d9de-408e-8a24-c9ce562ca263 req-f3f028d1-5eab-489f-b4fc-cdd77552f77e service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-changed-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:18:57 user nova-compute[72000]: DEBUG nova.compute.manager [req-41c587e9-d9de-408e-8a24-c9ce562ca263 req-f3f028d1-5eab-489f-b4fc-cdd77552f77e service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Refreshing instance network info cache due to event network-changed-7a95cb11-6dd9-40e0-a2b7-178813f4894b. {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 16 19:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-41c587e9-d9de-408e-8a24-c9ce562ca263 req-f3f028d1-5eab-489f-b4fc-cdd77552f77e service nova] Acquiring lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-41c587e9-d9de-408e-8a24-c9ce562ca263 req-f3f028d1-5eab-489f-b4fc-cdd77552f77e service nova] Acquired lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:18:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-41c587e9-d9de-408e-8a24-c9ce562ca263 req-f3f028d1-5eab-489f-b4fc-cdd77552f77e service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Refreshing network info cache for port 7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 16 19:18:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-41c587e9-d9de-408e-8a24-c9ce562ca263 req-f3f028d1-5eab-489f-b4fc-cdd77552f77e service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updated VIF entry in instance network info cache for port 7a95cb11-6dd9-40e0-a2b7-178813f4894b. {{(pid=72000) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 16 19:18:57 user nova-compute[72000]: DEBUG nova.network.neutron [req-41c587e9-d9de-408e-8a24-c9ce562ca263 req-f3f028d1-5eab-489f-b4fc-cdd77552f77e service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updating instance_info_cache with network_info: [{"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:18:57 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-41c587e9-d9de-408e-8a24-c9ce562ca263 req-f3f028d1-5eab-489f-b4fc-cdd77552f77e service nova] Releasing lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:18:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:18:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:18:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:18:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:18:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:19:00 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lazy-loading 'flavor' on Instance uuid 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:19:01 user nova-compute[72000]: INFO nova.compute.manager [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Attaching volume 6efd93e6-29c3-46c7-aa70-3ede65d02fa7 to /dev/vdb
Aug 16 19:19:01 user nova-compute[72000]: DEBUG os_brick.utils [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[30008395-8753-4c39-98bc-1954dd8d0a82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:303a22c6dbb\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5921077c-79b8-4dc5-b752-88b428bef1d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33a837c-9704-41e8-a56c-5a2493328319]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[555647a8-5043-4391-b640-3df9a58b9430]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Running cmd (subprocess): nvme version {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] 'nvme version' failed. Not Retrying. {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] nvme not present on system {{(pid=72000) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 16 19:19:01 user nova-compute[72000]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 16 19:19:01 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[57512563-b3dd-4fa8-97fb-863d47561808]: (4, '') {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72000) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.lightos [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] LIGHTOS: no hostnqn found. {{(pid=72000) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG os_brick.utils [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:303a22c6dbb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:19:01 user nova-compute[72000]: DEBUG nova.virt.block_device [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updating existing volume attachment record: 03bf7aca-eb49-47a4-aa37-c2d9bd8a2f12 {{(pid=72000) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 16 19:19:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:05 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:19:15 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:16 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Calling os-brick to attach iSCSI Volume {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsImyQnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:19:18 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:19:18 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:19:18 user nova-compute[72000]: INFO os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9b2605-9ceb-4212-b6bb-b405fc61e950]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 16 19:19:18 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[772bdeb2-dd95-4856-a6e8-7cd6707789ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7] added\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7] added
Aug 16 19:19:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[636a76cf-b543-4dde-84a2-8f5d4ad25e50]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e930a2f-dc1d-4d09-a536-42c8b72e9f7a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsImyQnZ {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsImyQnZ" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ad0722-a600-4a65-b4f5-ab53a53b21cb]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsImyQnZ'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[8559174d-2cb5-4021-a38b-e6b40d376fc6]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[6740ba50-d5d0-42ef-a869-941bbb788c6b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 16 19:19:18 user nova-compute[72000]:  {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 16 19:19:18 user nova-compute[72000]:  {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:19:18 user nova-compute[72000]: WARNING os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 16 19:19:18 user nova-compute[72000]: 
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --login {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6b247d-502b-4f87-98f7-ff26abdcf525]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7, portal: 172.16.0.220,3260]
Aug 16 19:19:18 user nova-compute[72000]: Login to [iface: default, target: iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7, portal: 172.16.0.220,3260] successful.
Aug 16 19:19:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec2ac4a-e3ba-44e4-854a-c92eb48db669]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7ded20-d4d0-4069-9cc2-440e496038b6]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 (non-flash)
Aug 16 19:19:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 (non-flash)
Aug 16 19:19:18 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Connected to 172.16.0.220:3260 {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72000) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72000) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[047e4db6-ff51-449c-975b-dae24d86125a]: (4, ('- - 0', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72000) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsImyQnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72000) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquired lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Forcefully refreshing network info cache for instance {{(pid=72000) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG nova.objects.instance [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lazy-loading 'info_cache' on Instance uuid 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:19:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:19 user nova-compute[72000]: DEBUG nova.network.neutron [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updating instance_info_cache with network_info: [{"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:19:19 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Releasing lock "refresh_cache-991f28f8-9d8a-4fbe-941a-3e0803d0d16f" {{(pid=72000) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 16 19:19:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updated the network info_cache for instance {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 16 19:19:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:19:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:19:19 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26361353462323262', 'path': '/dev/sdb'} {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:19:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361353462323262', 'path': '/dev/sdb'} {{(pid=72000) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 16 19:19:19 user nova-compute[72000]: DEBUG nova.objects.instance [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lazy-loading 'flavor' on Instance uuid 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:19:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] attach device xml: <disk type="block" device="disk">
Aug 16 19:19:19 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:19:19 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 19:19:19 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 19:19:19 user nova-compute[72000]:   <serial>6efd93e6-29c3-46c7-aa70-3ede65d02fa7</serial>
Aug 16 19:19:19 user nova-compute[72000]: </disk>
Aug 16 19:19:19 user nova-compute[72000]:  {{(pid=72000) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 16 19:19:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] No BDM found with device name vda, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:19:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72000) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 16 19:19:20 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] No VIF found with MAC fa:16:3e:fd:64:4c, not building metadata {{(pid=72000) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 16 19:19:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-f77c8537-8bc3-470e-a59b-fd9a891754d6 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.582s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:19:21 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:19:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:19:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:19:21 user nova-compute[72000]: INFO nova.compute.manager [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Detaching volume 6efd93e6-29c3-46c7-aa70-3ede65d02fa7
Aug 16 19:19:21 user nova-compute[72000]: INFO nova.virt.block_device [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Attempting to driver detach volume 6efd93e6-29c3-46c7-aa70-3ede65d02fa7 from mountpoint /dev/vdb
Aug 16 19:19:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Attempting to detach device vdb from instance 991f28f8-9d8a-4fbe-941a-3e0803d0d16f from the persistent domain config. {{(pid=72000) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 16 19:19:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 19:19:21 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:19:21 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 19:19:21 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 19:19:21 user nova-compute[72000]:   <serial>6efd93e6-29c3-46c7-aa70-3ede65d02fa7</serial>
Aug 16 19:19:21 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 19:19:21 user nova-compute[72000]: </disk>
Aug 16 19:19:21 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 19:19:21 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Successfully detached device vdb from instance 991f28f8-9d8a-4fbe-941a-3e0803d0d16f from the persistent domain config.
Aug 16 19:19:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 991f28f8-9d8a-4fbe-941a-3e0803d0d16f from the live domain config. {{(pid=72000) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 16 19:19:21 user nova-compute[72000]: DEBUG nova.virt.libvirt.guest [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] detach device xml: <disk type="block" device="disk">
Aug 16 19:19:21 user nova-compute[72000]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 16 19:19:21 user nova-compute[72000]:   <source dev="/dev/sdb"/>
Aug 16 19:19:21 user nova-compute[72000]:   <target dev="vdb" bus="virtio"/>
Aug 16 19:19:21 user nova-compute[72000]:   <serial>6efd93e6-29c3-46c7-aa70-3ede65d02fa7</serial>
Aug 16 19:19:21 user nova-compute[72000]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 16 19:19:21 user nova-compute[72000]: </disk>
Aug 16 19:19:21 user nova-compute[72000]:  {{(pid=72000) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-220f4239-cefb-4cc8-a7b0-bdb94f111404 None None] Received event <DeviceRemovedEvent: 1692213562.2591228, 991f28f8-9d8a-4fbe-941a-3e0803d0d16f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72000) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.driver [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 16 19:19:22 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Successfully detached device vdb from instance 991f28f8-9d8a-4fbe-941a-3e0803d0d16f from the live domain config.
Aug 16 19:19:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] calling os-brick to detach iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd0101a9180>, {'target_iqns': ['iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsImyQnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 16 19:19:22 user nova-compute[72000]: WARNING os_brick.initiator.connectors.base [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7', 0)] {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29a7c25-3332-4cef-92db-f191d5c57f0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd725998-2b2f-4ad0-8f5e-1a62ad3c69a0]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 (non-flash)\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 (non-flash)
Aug 16 19:19:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 (non-flash)
Aug 16 19:19:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd0113981f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7'): ({'sdb'}, set())}) {{(pid=72000) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Removing single pathed devices sdb {{(pid=72000) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d73b249-cb1b-464b-8075-9aea9aa5e16d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab308f5-7880-47be-aa79-09867423fe67]: (4, ('ok\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Flushing IO for device /dev/sdb {{(pid=72000) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9284e3e-b231-4bb7-85ec-f56ed781015a]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72000) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[68675daf-7f2f-4ea5-b0be-106d97092679]: (4, ('1', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.linuxscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] SCSI volumes sdb have been removed. {{(pid=72000) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7')] {{(pid=72000) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e9f94c-b583-4e2c-ae9a-6bcb5ae1dc9d]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --logout {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bcfa1a-6f26-4b00-888a-3e8f619a30fa]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7, portal: 172.16.0.220,3260]
Aug 16 19:19:22 user nova-compute[72000]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7, portal: 172.16.0.220,3260] successful.
Aug 16 19:19:22 user nova-compute[72000]:  stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op delete {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6efd93e6-29c3-46c7-aa70-3ede65d02fa7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83463) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG oslo.privsep.daemon [-] privsep: reply[31155d47-4de1-4cf5-9966-4cb44491512b]: (4, ('', '')) {{(pid=83463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72000) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.base [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] <== disconnect_volume: return (287ms) None {{(pid=72000) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 16 19:19:22 user nova-compute[72000]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Disconnected iSCSI Volume {{(pid=72000) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 16 19:19:23 user nova-compute[72000]: DEBUG nova.objects.instance [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lazy-loading 'flavor' on Instance uuid 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:19:23 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-3dd9208f-7737-4db8-8cbe-2abe60d37c8e tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:19:23 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:24 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:19:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:19:26 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:19:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:19:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:27 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.processutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72000) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 16 19:19:28 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:19:28 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:19:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=23.444393157958984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Instance 991f28f8-9d8a-4fbe-941a-3e0803d0d16f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72000) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:19:28 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:30 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:19:33 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:34 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:19:38 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:19:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:19:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:19:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:19:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:19:43 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:19:48 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:53 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:19:58 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:20:03 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:20:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:20:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:20:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:20:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:20:08 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:13 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:18 user nova-compute[72000]: INFO nova.compute.manager [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Terminating instance
Aug 16 19:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Start destroying the instance on the hypervisor. {{(pid=72000) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Skipping network cache update for instance because it is being deleted. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-d98b231c-30c0-4313-ab38-ffaada33eb4f req-3743afb4-cdfd-4871-bf35-15bada9d622a service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-unplugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d98b231c-30c0-4313-ab38-ffaada33eb4f req-3743afb4-cdfd-4871-bf35-15bada9d622a service nova] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d98b231c-30c0-4313-ab38-ffaada33eb4f req-3743afb4-cdfd-4871-bf35-15bada9d622a service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-d98b231c-30c0-4313-ab38-ffaada33eb4f req-3743afb4-cdfd-4871-bf35-15bada9d622a service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-d98b231c-30c0-4313-ab38-ffaada33eb4f req-3743afb4-cdfd-4871-bf35-15bada9d622a service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] No waiting events found dispatching network-vif-unplugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:20:18 user nova-compute[72000]: DEBUG nova.compute.manager [req-d98b231c-30c0-4313-ab38-ffaada33eb4f req-3743afb4-cdfd-4871-bf35-15bada9d622a service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-unplugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:19 user nova-compute[72000]: INFO nova.virt.libvirt.driver [-] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Instance destroyed successfully.
Aug 16 19:20:19 user nova-compute[72000]: DEBUG nova.objects.instance [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lazy-loading 'resources' on Instance uuid 991f28f8-9d8a-4fbe-941a-3e0803d0d16f {{(pid=72000) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG nova.virt.libvirt.vif [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-16T19:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1135173549',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1135173549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1135173',id=52,image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoRCh/iZiDgxuBnH4kLni55sJeahpOa+SJekMgfv6hBELKmFWD+98SPuI+z6HmzLqDm7qeD9j/abso92C9DTUydYVRWL0qAVsueUkMMQCLr6eyQ2gvumCA1xnHne6YeEQ==',key_name='tempest-keypair-1997659152',keypairs=<?>,launch_index=0,launched_at=2023-08-16T19:17:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1b6e1dd48d74e0fa07bd8f137f6e297',ramdisk_id='',reservation_id='r-o9l6grra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c19ae381-62a6-4e07-8c3a-fefacf5c24ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1616600434',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-16T19:17:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2dec782e22a546818eebc76df9f12f79',uuid=991f28f8-9d8a-4fbe-941a-3e0803d0d16f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Converting VIF {"id": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "address": "fa:16:3e:fd:64:4c", "network": {"id": "fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-238827817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b6e1dd48d74e0fa07bd8f137f6e297", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a95cb11-6d", "ovs_interfaceid": "7a95cb11-6dd9-40e0-a2b7-178813f4894b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG nova.network.os_vif_util [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:64:4c,bridge_name='br-int',has_traffic_filtering=True,id=7a95cb11-6dd9-40e0-a2b7-178813f4894b,network=Network(fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a95cb11-6d') {{(pid=72000) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG os_vif [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:64:4c,bridge_name='br-int',has_traffic_filtering=True,id=7a95cb11-6dd9-40e0-a2b7-178813f4894b,network=Network(fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a95cb11-6d') {{(pid=72000) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a95cb11-6d, bridge=br-int, if_exists=True) {{(pid=72000) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:20:19 user nova-compute[72000]: INFO os_vif [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:64:4c,bridge_name='br-int',has_traffic_filtering=True,id=7a95cb11-6dd9-40e0-a2b7-178813f4894b,network=Network(fa3fedbb-e0ee-41cb-a4d6-bcafa2b4b277),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a95cb11-6d')
Aug 16 19:20:19 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Deleting instance files /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f_del
Aug 16 19:20:19 user nova-compute[72000]: INFO nova.virt.libvirt.driver [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Deletion of /opt/stack/data/nova/instances/991f28f8-9d8a-4fbe-941a-3e0803d0d16f_del complete
Aug 16 19:20:19 user nova-compute[72000]: INFO nova.compute.manager [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 16 19:20:19 user nova-compute[72000]: DEBUG oslo.service.loopingcall [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72000) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG nova.compute.manager [-] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Deallocating network for instance {{(pid=72000) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] deallocate_for_instance() {{(pid=72000) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] No waiting events found dispatching network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:20:20 user nova-compute[72000]: WARNING nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received unexpected event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b for instance with vm_state active and task_state deleting.
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] No waiting events found dispatching network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:20:20 user nova-compute[72000]: WARNING nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received unexpected event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b for instance with vm_state active and task_state deleting.
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] No waiting events found dispatching network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:20:20 user nova-compute[72000]: WARNING nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received unexpected event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b for instance with vm_state active and task_state deleting.
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-unplugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] No waiting events found dispatching network-vif-unplugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-unplugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b for instance with task_state deleting. {{(pid=72000) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Acquiring lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] No waiting events found dispatching network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 16 19:20:20 user nova-compute[72000]: WARNING nova.compute.manager [req-2fe67b7d-93e9-4edf-b5a9-af5dae7d6360 req-dabfdd4e-fd05-492b-aab3-76dc53ce2225 service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received unexpected event network-vif-plugged-7a95cb11-6dd9-40e0-a2b7-178813f4894b for instance with vm_state active and task_state deleting.
Aug 16 19:20:20 user nova-compute[72000]: DEBUG nova.network.neutron [-] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Updating instance_info_cache with network_info: [] {{(pid=72000) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 16 19:20:21 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Took 1.56 seconds to deallocate network for instance.
Aug 16 19:20:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:21 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:20:21 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:20:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:21 user nova-compute[72000]: INFO nova.scheduler.client.report [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Deleted allocations for instance 991f28f8-9d8a-4fbe-941a-3e0803d0d16f
Aug 16 19:20:21 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-ad8413df-d488-4c2c-ab1a-f7265ab215b9 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434 tempest-TestServerVolumeAttachScenarioOldVersion-1616600434-project-member] Lock "991f28f8-9d8a-4fbe-941a-3e0803d0d16f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.889s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:20:22 user nova-compute[72000]: DEBUG nova.compute.manager [req-c01c6844-ab01-4a96-aee1-b808ae5e2469 req-c7b1bd9e-95ff-4114-be08-62f4aeaab21d service nova] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Received event network-vif-deleted-7a95cb11-6dd9-40e0-a2b7-178813f4894b {{(pid=72000) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 16 19:20:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:26 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:20:27 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:20:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:20:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:20:27 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:20:27 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=23.471420288085938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:20:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:20:27 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:20:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:20:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:20:28 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:20:28 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:20:28 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:20:28 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:20:29 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:20:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:20:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:20:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72000) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 16 19:20:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:20:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72000) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 16 19:20:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:31 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:20:34 user nova-compute[72000]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692213619.340108, 991f28f8-9d8a-4fbe-941a-3e0803d0d16f => Stopped> {{(pid=72000) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 16 19:20:34 user nova-compute[72000]: INFO nova.compute.manager [-] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] VM Stopped (Lifecycle Event)
Aug 16 19:20:34 user nova-compute[72000]: DEBUG nova.compute.manager [None req-a692486b-1a28-464b-8d56-c7e6a5274574 None None] [instance: 991f28f8-9d8a-4fbe-941a-3e0803d0d16f] Checking state {{(pid=72000) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 16 19:20:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:36 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:20:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:20:44 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:49 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:20:54 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 16 19:20:59 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:04 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:09 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:12 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:14 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:16 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:18 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:21:19 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:19 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:21:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Starting heal instance info cache {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 16 19:21:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Rebuilding the list of instances to heal {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 16 19:21:19 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Didn't find any instances for network info cache update. {{(pid=72000) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 16 19:21:20 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:21:22 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:21:23 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:21:24 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:28 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:21:29 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:29 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:21:29 user nova-compute[72000]: DEBUG nova.compute.manager [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72000) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 16 19:21:29 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager.update_available_resource {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:21:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:21:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:21:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:21:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Auditing locally available compute resources for user (node: user) {{(pid=72000) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 16 19:21:29 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:21:29 user nova-compute[72000]: WARNING nova.virt.libvirt.driver [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 16 19:21:29 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=23.468833923339844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=72000) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 16 19:21:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 16 19:21:29 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 16 19:21:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 16 19:21:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72000) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 16 19:21:30 user nova-compute[72000]: DEBUG nova.compute.provider_tree [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed in ProviderTree for provider: 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 {{(pid=72000) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 16 19:21:30 user nova-compute[72000]: DEBUG nova.scheduler.client.report [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Inventory has not changed for provider 41d2d9e5-ac93-4703-9b48-d29797f5aeb9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72000) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 16 19:21:30 user nova-compute[72000]: DEBUG nova.compute.resource_tracker [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Compute_service record updated for user:user {{(pid=72000) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 16 19:21:30 user nova-compute[72000]: DEBUG oslo_concurrency.lockutils [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=72000) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 16 19:21:32 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:21:34 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 16 19:21:37 user nova-compute[72000]: DEBUG oslo_service.periodic_task [None req-998b5379-d417-4e7b-91b0-102ae8741a1c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72000) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 16 19:21:39 user nova-compute[72000]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72000) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}